The only time I’ve experienced a big queue like that was around opening time (4am?) as they processed everyone to get in.
agree that is also frustrating that it’s the one desk for the 2 seperate lounges. Once BA and others move other those lounges will be a disaster