I never carry my passport around while traveling; I always leave it in the hotel.

The chances of losing it due to theft out on the street are probably considerably higher than being asked to produce it by local authorities.

The driver's license will have to do, if I'm even carrying that. If they want, they can accompany me back to my hotel where I will be happy to show them the passport.