There's no polite way to say this, but your approach is rude and selfish. If everyone took your approach, chaos would ensue. The social contract exists for a reason.

I let a woman jump a queue I had waited in for 15 minutes. I was polite, and not visibly frustrated, but she really irritated me as well as the people behind me who were muttering under their breaths.

Karma is real. If your plane goes down in the Hudson who do you think the people you cut in front of are going to help last?