Loan service

I app**** for a loan on Tuesday, I called back on Tuesday trying to cancel it. I called various numbers and didn't get through, later the evening the money comes into my account. Today I called again and was told I have to pay an extra amount of R1300 in order to cancel. Its been TWO days and I never even touched the money. This isn't fair because I didn't even know they would be open yesterday as it was a public holiday. The agent just kept telling me there's nothing she can do about me trying to cancel the loan on the same day it was approved.