I've had it happen too -- full Hilton in Fort Worth -- we were in the room and a guy opened the door thinking it was his -- he left , 15 minutes later I went down to the desk and said now you can change my keys too...
should have asked for more !
Bob H