In such cases the driver did not earn a tip
I have only carry-on, so the driver doesn't touch my stuff. There were several times that the driver didn't even bring me to the door of my hotel, but dropped me off across the street; on another trip he forgot about me, until he noticed that I was the last one left. I'm fed up with incompetent service people expecting tips.