Belligerent driver/deliver man

This morning there was a collection scheduled for me. The driver arrived and called me to say he was at the gate. Upon checking, I could not find him. I called him back and he told me he was parked across the road and promptly instructed me to walk over there to hand over the package. I told him he must come in and collect. He became rude and took his time getting to me. I honestly do not understand why delivery guys from you are constantly doing this. Is it not their job to deliver and collect? Why am I being expected to do their job?