In major hotel chains, you won't have any problems drinking tap water - from my experience. I'm talking Marriott, Hilton, Hyatt, etc.

Otherwise, as others have said, it's safe to brush your teeth or rinse your mouth with tap water but for drinking purposes you'd want to choose bottled water.