Accounts department useless

I am very upset, I have cancelled my debit order as I moved banks and I now just do an EFT every month, they refuse to cancel the debit order then bill for an unpaid debit order even though the account is paid, this has now lead to my account reflecting in arrears. Its ******* not to cancel a debit order.