The one caveat, though... If you are relying on an ATM to get cash, and it's a country where you can't get by on credit cards for small payments or, for example, the taxi from the airport, then make sure you know what to do if the bank decides to block your card.

(I have a very cautious bank which seems to auto-block my card in a number of destinations, including the US.)

You can mitigate against this to an extent by telling the bank in advance about your travel plans, but that doesn't always work. Make sure you have the fraud department's number available, and, if possible, something like a Skype app on your smartphone. And take some of your own currency with your (or travellers' cheques - about the only use left for them) in case you need to change some the old-fashioned way in an emergency.