How do you generally book your hotels? I usually book through Rakuten and never get asked for ID, presumably because my Japanese address is listed on the reservation.

I think the trouble goes back to the authorities sending out a badly-worded request to hotels some years ago and hotels didn't really understand what the law required. Maybe deliberate, but more likely incompetent. Now, places seem to understand that the requirement is only for non-residents.
I don't get asked for ID for rooms I book myself as I assume they have my address, but when work books rooms I have been asked, though none has been needed when I said I was a resident.

IIRC it's not just checking ID. Hotels are required to copy passports and the copies are later collected by police. What they do with these copies is anyone's guess. It's not do with room damage (though as Japanese hotels rarely require a card swipe on check in it might be a factor). It's not that the genuine tourists probably should show it, they must have it copied according to the law. However, it gets silly as there is nothing to stop anyone just saying they are a resident and making up an address as hotels aren't supposed to check ID in those cases. So not a very sensible law. Japan is certainly not the only country to required ID for hotel check in and non-resident citizens could also be required to show ID in some countries.

I don't know what has happened with others who don't get asked, but this non-resident has been asked for his passport in every case of dozens of hotel stays all over Japan over the last 10 years. Never been stopped by police but always carry it and always have to show it at hotels.

As for telling an officer to f--off, I have a different perspective. After 30+ years in the business and several more as an academic in criminology-law enforcement, I know how tough the first few years are and just don't even think of deliberately being an adam henry to an officer just because I can. How stupid! It only takes a minute to show the pp, answer a couple of questions and part with a smile. 40 years ago I appreciated those who did the same, albeit in different circumstances. I realize the level of professionalism in Japanese police is rather lacking but still, why deliberately make someone's day worse just from encountering you?

Same. They usually ask me for my name and mobile number (and sometimes my address), but I can write what I'd like and they do not ask for ID.

Repeatedly asking me for ID because I fit a racial profile would make my day worse. So I'll ask "is this voluntary?" and decline to comply unless I have to. And if that makes the day seem less happy for Constable Plod, he can take it up with his superiors. Perhaps they'll stop sending him on such a fool's errand.

Like the other residents here, I've been asked for a passport a few times when checking in, but after noting that I live here I've never been challenged or actually required to show a photo ID... it does help to write the address in Japanese on the ubiquitous check-in form (which asks you for information the hotel does, in almost all cases, already have...)

I just did that earlier tonight somewhere in Q Shoe. Put down a valid address and phone number, just not mine. Guy at the desk didn't blink, and didn't ask me for any kind of ID. Probably helps I made the reservation on their own website in Japanese. The fact that it wasn't done from Japan seems to have escaped them.

Not the same as "f--off." No problem with this.