I agree with what's been said here, there's also an increasing number of Citibank ATM's and I use those when I can with my Citi account which is fee-free.

To answer your cash question, I usually take some 100's with me just in case since I have been in places where the networks have all been down for several days. In reality, I haven't had to exchange one in some time. Though they do need to be in near perfect condition or they'll reject them.