In my opinion there is a significant difference between certain gates (at AMS for example):

• C-gates, where security is not done at gate. Most gates have a dedicated line for SkyPriority. Failure to implement is due to gate agent (start SP line same time as regular line, do not check who is in line etc);
• Non-Schenen D-gates, security at the gate makes SkyPriority difficult to enforce as you have to cut in line. Once in holding pen, it if normally free for all;
• Long-haul gates normally have a dedicated line before the holding pen. Once boarding is started it is normally free for all (i.e. failure to implement due to gate agent) (not applicable for this discussion, but worth noting).

Therefore the solution would depend on the gate:

• C-gates:
  Ensure the gate agent checks who is in the SP line, ensure SP line boards before rest and once SP has finished boarding keep the line free in case elites arrive later (and not board non SP passengers through the SP line);
• D-gates (non-Schengen):
  Ensure that the security agents are aware that the SP passengers can cut in line and do boarding pass checks before entering the aircraft from the holding pen.

That said, the biggest advantage of priority boarding is that you are certain to have space for your hand-luggage. If I do not have any hand-luggage I personally am not too bothered by standing in line.