Pay back my deposit

I recently moved out of Lisa's place . When I first moved into the flat I refused to sign the clearance or inspection document as many things were not in order. The flat was not clean and a lot of defects noted in the flat. Which majority were never sorted out. Now city property is delaying my deposit and want to charge me for things they are not even sure if they weren't broken when I first moved in. They confirmed on email that they can't find any record of the initial inspection. So why am I being ****** of my deposit if your caretaker did not follow the correct process? Pay my full deposit back before I take this matter to court