First for Women Insurance Debit order

I cancelled my policy with First for Women Insurance early in December and received an email confirming this cancellation. The agent at First For Woman assured me that my debit order will be cancelled, however it was not. I emailed their customer complaints department, and received no.response. Thereafter I called their Customer Care.Department and was informed that it was a mistake on the system, and that I needed to contact my bank, that there was nothing they could do. I then contacted my bank and was informed that I need to pay a fine to reverse the debit order! This is very inconvenient and unacceptable!