If I am travelling with a few colleagues I try to make it fair give everyone a chance for lounge access.
On a recent trip I had 4 sectors and took each colleague in the lounge before each sector. I can understand that may be a bit convoluted but it was the fairest thing at the time, besides I was there for each visit