My understanding is that every Japanese credit card has about 2% baked into the foreign exchange rate as a foreign currency fee.
Citibank currently offers a dollar-denominated Visa card in Japan, although I have no idea whether the to-be-determined buyer of their Japan retail operation will keep that product going.