Not rude at all! Keep in mind Premier Access is often offered as a $10-$20 fee during OLCI and I suspect a number of travellers just assumed you paid the fee. Obviously there would be nothing unfair in their mind if you paid $20 to get to the front of the line.
-James