Cash Finance Fee

So I was looking through my account statements and noticed that there is a cash finance fee. Upon taking a look I noticed that every month I get charged a cash finance fee on my Credit Card. Upon phoning the helpdesk I get told there is nothing they can do about it, because back in November of 2014 I did something to activate this. Now they cannot deactivate it, the only way is to pay off the entire credit card. At this point in time I am thinking of paying it off by moving my account to another bank, as come off of it something that happened in 2014 that I have no recollection of and no phone call or warning of has been charging me every month? Surely a phone call would've at least told me that this was being done?