I've actually been called out by a gate agent for using the Military group before, I had a cool job a while back that allowed me to have a beard, and before I was flying enough to regularly have 75k/100k. It was reasonable to assume I wasn't active duty with the beard, but a flash of a CAC later and I was on my way.

But you can usually tell pretty quickly who is and who isn't.