Poor workmanship

Bought a 40" smart TV. I used the USD port once and when I pulled it out, a rubber piece that was inside the port came out with it which meant that I could not plug my external into anything else nor use the USB port because it didn't pick up anything that was inserted. Mind you, the TV is under a 4 year warranty. I called them and they said that the USB is an accessory of the TV so if I want it fixed then I have to pay.