Unfortunately, the airlines refusal to enforce carry-on limits while simultaneously charging for check bags has turned the boarding process into a free for all. I used to have your same mentality and would hang back and board late. If I did that now, my carry-on would not make it onto a crowded flight.

Breezeway / priority boarding don't matter to much if you have checked luggage but they are a bigger perk than ever if you are a carry-on only traveler.