Join Date: Oct 2006
Location: London, UK
Programs: BA Gold, VS Silver, SQ Silver, IHG Plat Amb, Hilton Gold, Marriott Plat, Accor Silver, Radisson Prem
Posts: 16,871
No, I have done this many times.
A quick polite word with the gate agent, mention priority boarding and flash your BP/card and you're done.
As long as you try and ensure those in the queue see the agent invite you to cut in front (once you've spoken to the agent), then generally there are no bad feelings (expressed, at least).