Those who say the reason is the high fee charged merchants to accept credit cards are correct. This is yet another example of how the bank cartel stifles the Japanese economy. The bad banking system is virtually all of the reason that Japanese still prefer cash, it's not cultural.
Costco would be an exception since Costco has a global agreement with Amex.