The Starter Site documentation tends to lead you astray here, most people start trying to change the catalogs without success. The answer is to change the Web.config from
commerceComponents baseCurrencyCode="USD" baseCurrencyCulture="en-US"
to (for example)
commerceComponents baseCurrencyCode="EUR" baseCurrencyCulture="de-DE"