Unhappy client/poor service

I went to get my account closed, paid it off and requested they unsubscribe me from their magazines and everything. The gentleman I spoke with said there is another option of just blocking the account and there will not be anymore charges and whenever I want to reopen it I can do so without having to open a new account. I regret not cancelling it all together. To my surprise it still appears on credit score and it is in arrears I then called again and the lady I spoke to assured me to have unsubscribed the magazines and laid a complaint for me as I refused to pay the amount that’s due as according to me I paid everything and even unsubscribed. The account is still there and the bill is increasing. I am very upset and this is creating a bad name for me.