Happens all the time. People run off to retrieve an item they left in the boardingarea or go talk to the agent about upgrading and a variety of other reasons. I always take a quick look at their boarding pass to see their seat assignment and then make sure they're back in their seat before we leave.