I use mine all the time as ID. As in it's the only ID I'm going to present. They can like it or lump it. If someone questions what it is, I tell them it's my "Federal ID" and that seems to satisfy their questions. If they ask any further questions, I inform them the government only issues these after a background check AND interview with a federal agent. That always shuts them up.
I love using it for this purpose -- no barcodes/magstripes the stores can scan when buying booze or making a return. No address or other info they don't need. In Florida there are a ton of gated communities which love to scan/swipe IDs. Go ahead. That's all you're getting from me. No DL, nothing else. I'd imagine the PassID # is useless to just about anyone but CBP/TSA. I seriously doubt most local yokel police would know what to do with it.
To be honest, the idea of presenting ID to verify identity is completely flawed. You're asking the person in question to verify their own identity using their own documents. In my high school, we used to make fake IDs as a yearbook fundraiser. We had all of the equipment one would want...including some DMV laminate with UV printing that someone pinched from the DMV licensing bus. Ours actually looked more real than the DMVs.