If the default Catalog language is not en-US, it will not let you delete en-US, you get the error "cannot delete default language.
Heard the solution from one of the delegates in my Commerce Server Experts Training, you need to change the language of the Catalog Manager temporarily away from en-US.
With thanks to Ralf Höppner.