It's a no-win in my opinion. I've tried and have just given up.
My other pet peeve: when the AC vents face the bed. My barometer of a well designed hotel room is for when the vents face in a direction other than the bed. This way the room is cooled but I don't get the draft.