In Japan, it is often usual to have many ATM's locked up after hours. (I've seen this in Kobe and Nagoya, not so much in Tokyo).
I always use my ATM or no cash advance fee credit card overseas, but I do take a bit of extra American money to change in case of an emergency when the ATM's are not available.