If this was on the other foot they won't be accepting me cancelling

I sign a contract and in 2 weeks time they say it is not valid. Since when does any organisation have so long to cancel a contract ?