As a general rule, when does boarding from the lounge tend to start at Heathrow?

I like to have plenty of time to settle in to my seat, so if lounge boarding is a last minute thing is it worth leaving the lounge and going to the gate? Does gate boarding have a separate F/J queue?