Dissatisfied customer

Hi. My name is Likeleli I'm a standard bank client for ages. I would like to express my dissatisfaction against the uncalled debit orders fro different insurance companies on my account. Lately I have been a victim of Regent insurance. I tried to go and stop the debit order with no luck but instead I got double deduction from them, and guess what?" The bank cannot do anything on that because they did not authorise the debit order". Please tell me what to do because I feel like closing this account and move on to another bank.