My credit union credit and debit cards only have the 1% Visa charge for foreign use. My US HSBC ATM card only has a 1% charge when used at HSBC ATMs abroad. I have verified these against claims with actual transactions against the interbank rates.
You can find cheaper currency conversion, you just have to look for it.