I have to agree with the frequent visitors and/or residents. I've never been stopped by the police once in the past ten years. OTOH, Mizuho bank usually wants 50 different forms of ID and proof of blood type anytime I want to deposit money in my account.
Different styles of dress and fashion which are totally acceptable and possibly normal in other countries can appear to be "different" here and may be considered suspicious. What may be considered "normal" to the OP may be highly unusual in Japan.