I never mind it. It is the fun part when you try and pick the frequent flyer in the crowd, taking peeks at BP's... Then when the announcement is made pushing your way through them to get on board just knowing that they are looking at you like they want to kick you
What I usually do is stand around, and as soon as one of the "lice" leaves their seat moving towards the gate expecting to get on soon, I simply take their seat...