Depending on your bank card, you may have to look for an ATM affiliated with the Japanese post office (yubinkyoku) to get money out.
Look for this sign.
Citibank's ATMS have proved erratic for me, whereas the post office machines have always been dependable.