Recycled numbers?

I received a new number with MTN that clearly very recently belonged to someone else and has been recycled. How do you recycle a recent number? It has resulted in unending stress for me with harassment from this persons bank as she is not paying her credit card. Is this something that can be resolved without me having to change the number. Its ridiculous.