Cancelled membership still being debited

Myself and my partner cancelled our membership at the end of March and gave a month's notice. We asked for some kind of confirmation and we were told that they don't send anything, they just update their systems. Now we've both been debited and phoning, emailing and requesting a call back hasn't worked. Their telephone system is useless. We want an explanation and our funds returned to us.