I've been denied access to a Priority pass lounge only once, it was the Wingtips lounge @ JFK. I was admitted 10-20 mins later once people had cleared out for a flight. In their defense it was also the peak of the evening rush of international departures.
I'd suspect its very much YMMV, both with the lounge and PP.