silverline taking no responsibility for money paid

We signed a contract with silverline for building a house for us. We paid a dep. To contractor. After friends also build a house through him we decided to cancell with silverline. 10% of a double story house was paid and there is not even a brick on site. Silverline says they take no responsibility...