Currency exchange
If you're a customer at a large bank, they will have most foreign currencies available at not-bad rates at their downtown branch. Many will also (given a few days' time) have foreign currency sent to your neighborhood branch for you to pickup.
ATM rates in the foreign country are still better. I usually go to Northern Trust for about the equivalent of $100, just so I don't need to find an ATM immediately on arrival.