@ volar - I don’t know how often you make use of the various BA J or F lounges, but can assure you that there are many periods when they are far from the quiet haven one might wish them to be.
I simply dread to think just what sort of atmosphere would result if access were (officially) widened yet further, so as to include non-BA flyers.