Made my account inactive,but still took my money

I use an ABSA credit card machine for my business and it just stopped working in July last year. We didn't make much of it as it was always very unreliable. We tried multiple times to do transactions, but alas every time it did not go through. We made another plan for transactions such as asking our clients to do EFT's as well as SnapScan, a great service from another, much more efficient bank. In December we called and did not take down a reference number, so apparently this call never happened... I phoned again today as I tried on Friday to do a transaction and I was informed that our account has been made inactive, without my consent. To my total surprise, they have the authority to make your account inactive, but they still take the money on a monthly basis. No one phoned us to ask whether we still need this service, not a single email to inform us that we are paying for NOTHING, just an attitude to say we didn't use the machine, which also does not log all the failed attempts of trying to use it and looking like idiots with our clients when this service did not work!!!! I am definitely stopping all my services with ABSA, as I can no longer pay for NOTHING.