Really depends on where you're going. In SEA countries like Thailand, Malaysia, Singapore for eg. changing money at a licensed Forex Money Changer (usually in big malls) is extremely easy and offers way better rates compared to the banks.
Locals in those countries usually change money prior to going overseas and would never think of using the ATM unless it was an emergency.