I have no evidence to support this, but I think it's a non-issue for you. Might be an issue for the store that sold the item to you, but I can't imagine Japanese bureaucrats would be coordinated enough to care about you. But to make things less complex for all concerned, I'd remove the paper from your passport.