In Japan you will need to use the ATM's either at the Airport or Post Offices, unless your Hotel has one. The general street ATM's will not take foreign cards.

Japan is a cash society, credit cards are not accepted at most traditional places, so many people carry around large sums of cash with little risk of being mugged.

I have withdrawn via Visa 100000yen (about $1000) by mistake successfully at a Post Office, just watch the 0's!