I used to work as checkin/gate staff for BA at an outstation, and did the odd stint in the lounge to cover breaks. Most of those times, at least one person would come in and chance it, and generally left after being told they weren’t allowed in. I have heard a few horror stories though!