Yup, many places won't take my wife's non-driver ID (vision issues.) At least they have a sort-of justification: It lacks an expiration date.

We've never gotten any DUI comments but we have gotten multiple places asking for a driver's license. (Idiots, don't they know you can't have both a non-driver's ID and a driver's license at the same time?!)

I do recall an incident from some years back:

She was trying to cash a check at the bank of issue as it's issuer was extremely careless about whether the funds were there. Her non-driver's ID was rejected because of the lack of an expiration date. (At that time it only a few years old.) We come back with her passport. They want to see something else--out comes the non-driver's ID. They really whine about the passport because they don't know what to do about it, they want a driver's license. They finally grudgingly accept the passport.

She's never tried the non-driver's ID on the TSA as every flight she has taken since the TSA existed has been international. Leaving from the domestic terminal here we have gotten some whining about using our passports but that's always been easily shut up by pointing out that where we are going we must have passports but have no use for driver's licenses.