Budget refuses to cancel my policy

Budget has really dropped the ball. I have been insured with them before and never had issues. I tool out car insurance 1 year ago with them and then i was given a 30% increase this year with no good reason as i havent claimed and my vehicle has depreciated. I then found another insurer and cancelled with budget, obviously they tried to retain me and i agreed that if they beat the competitors premium i would stay, they couldnt beat the quote and i never heard back. I was then debited for the increased premium so i requested a call back which never happened. I got my bank to reverse the debit and now i am still getting messages requesting payment. IF ANYONE AT BUDGET READS THIS, PLEASE CANCEL MY POLICY!!!