Before, I used a driver's license because other cards, such as NEXUS, Global Entry, Sentri, were too rare and not familiar to the TSA. I am starting to rethink this. If you lose your driver's license, you may not be able to rent a car at your destination. A passport is hard to replace while traveling.
I am thinking of starting to use either a trusted traveler card or buy a passport card.