Believe it or not, the rule is actually for the benefit of FTers (and similar). You know those frequent complaints about lounges being overcrowded? Well BA decided strictly not to allow their staff to contribute to the problem.
A small number of very senior managers are given Silver (some Gold) cards though, to allow them to bypass it.