Cancelling Budget insurance

On the 9th November I cancelled my home insurance with Budget insurance via telephone. They tried to stop me by sending a revised proposal. I rep**** with a firm refusal. On the 25th November I was phoned re my cancellation. I stated I no longer wanted insurance. Despite this, my premiums were deducted, causing other stop orders to bounce. I went to the bank, and at my expense had the stop orders reversed. On the 14th December, Budget phoned me saying my house was not covered as I had not paid. I was angry...told them the insurance was cancelled, pointing out, as a pensioner,how much they had cost me in bank fees. I received later that day, an email cancelling the insurance. Last night, the 31st December,the insurance came off again. This will cause my other stop orders to bounce again,I will have to go to the bank and reverse things at my expense again. I am a pensioner and a diabetic....I have no money to live on now....I have no guarantee that this won't continue to happen. I am angry with Budget for putting me in this position. What now Budget? Do I get my premiums back...What about all the bank charges twice now?