The best advice is still to have some cash with you at all times. CC acceptance has gotten a lot better in Japan recently but that doesn't help you if you find yourself in a neighborhood with one convenience store that still only takes cash.
I'd say it's kinda the same as New York at this point... the major chains all take CC's but a lot of local delis and bodegas don't, or they have a minimum charge.