Bad latency for months

Recently moved to Vredekloof in Brackenfell and got 4mb line from Telkom. MWeb is the service provider. At the start I had about 200ms latency on the line. Telkom addressed the issue and it went down to about 50-75ms. This is still not what is should be. If I ping the server at 2am for example I get 2-5ms ping. So it's an congested exchange I would imagine. I've logged this issue twice but still have no better latency on the line. Since I mostly game online this makes the line almost useless to me.