returning of goods a nightmare

I had purchased a swimming costume from miladys gateway and was told by both staff members of which one was management that I could return or exchange in another store where I live (port Shepstone) if it was not used and had the protective patch. I had ask this question at least 3 times before the purchase was made- as it was with my credit card. I brought the item home then decided the colour was too dull so I decided to take back the item to miladys port Shepstone where they refuse to do the return. They told me the company as a whole does not take back swimwear. I did explain what I was told otherwise by miladys gateway but no further assistance was done from store level. The item I am returning has kimbles still on and protective patch on and never used. I am truly disappointed at the pathetic service received as a customer and an account holder as I was made to be **** when I was told the item couldn't be returned. I want my stuff returned as I was wronged and actually considering closing even my store card.