Refusal to pay back deposit and not paying deposit

We have stayed in a flatlet that Graeme is renting out and in good faith when he let us know it was coming available we arranged deposit and paid over a portion. We asked numerous times to view the flatlet as our needs had changed a little as our new baby had been born. He stalled and on good faith we paid the balance due and still waited. Graeme had not advertised the place as we said we were interested but two and a half weeks later he made it available to view. Mentioning to us that a particular door needed to be repaired as they broke in there and a new building was being built up next door which caused a security risk we opted not to take the place, he has paid over half the deposit but refuses to pay over balance as he feels legally he does not have too.<br> He has not put our deposit into a trust as required and never gave us the opportunity to view the property in a timely manner. I believe that it is a combination of errors but he has been enriched at our expense and stalled for long enough to be in their favour. I feel we are not liable for this at all and would like to be reimbursed in full.