It may not be the best, but don't be afraid to use the exchange booths at the airport upon arrival. Unlike most other countries, the ones in Japan charge a reasonable commission: 2.5% for cash exchanges. Compare this to 14% that the Travelex booths in the US normally charge - I would avoid those except if there's no other option.