I just don't like the idea of my driver knowing I am away and the house is empty.
If you are traveling away from home, then by definition the origin and destination of the UBER or LYFT trip will not be your house. Even if your driver could divine your house address, they are in a completely different city, how would they use that info? And finally, if no one is home, then there is no danger of personal injury.
edit: Sorry just realized you meant rides to/from airport as opposed to rides in a different city. Just have pickup or drop off at a nearby intersection or starbucks or mcdonalds.