If you are obviously American/non Japanese, if you stand on a street corner looking confused even for a minute or two, someone will come up to you in excellent English and offer to help you.

Seriously, I wouldn't worry--especially in major cities.

Even better is to have printed out your destination in Japanese on a little piece of paper and show it to someone.

We found people so helpful, it almost got annoying In a good way.