Yep, definitely not as ubiquitous as in North America. Sometime you may have to resort to tap water in restrooms (hopefuly cold will be available, but not always). My advice, get the name in the local language (wikipedia is good for such translations) and take a picture of one with your cellphone at home so you can show it when you ask for one abroad.