Canceling my Telkom line, told its non-existent

I called the Telkom Call Centre to cancel my landline at home as I will be moving house and no longer need the line. I spoke to the agent who informed me that my account was cancelled in 2012 and I have a contract with Dimension Data. Now, when I signed up for the line, I did so with Telkom and not a third party. I receive bills on a monthly basis from Telkom. If I do not have a contract with Telkom can I please be refunded the money I have been paying for the past 3 years?! If not, I would like the line cancelled effective 1 March 2015. Thank you.