Either stop not recognizing your own passport and throwing it away, or take some more care not to leave it somewhere that anyone else has access to it, so they can make that mistake.

Where are you leaving such an important document that others have access to it when you're not there? Surely you don't just leave it on a nightstand with various scraps of paper, empty cans, etc., during the day at a hotel, do you?