That would be a sweeping generalisation, but true of some elite heavy routes such as some of the domestic flights. By way of counter example, when priority boarding was announced on yesterday evening's flight to Athens, I was the only passenger to come forward. Everyone else in club or with status was presumably still in the lounge!