I almost never had a problem. I almost always call housekeeping in the early AM and ask to have the room serviced at a specific time and I choose a time when I'm either out or don't care. If it's not feasible, I simply ask for towels or whatever I need and leave it at that.