Wikivoyage has number of phrasebooks for different languages.

An effort, just an effort to speak minimum amount of local phrases can help a lot. Nobody expects to you speak with locals fluently on their local language but if you don't behave like an arrogant tourists, than politeness and few local words might take you long way.