Optionally phone them one more time and inform them your next course of action is credit card chargeback.

Phone the card you used and walk them through what happened - they should reverse the payment. They're equally liable with Amazon. Edit: There's no guarantee Amazon will keep your account open after this - then again nor is that guaranteed after a CCJ.

Inform your local trading standards office and offer the same evidence.