More than once a child of mine has fallen asleep on a flight and it's not an easy feat to gather them (carry if small or awaken as peacefully as possible if larger). We often let others go by, saying so verbally and clearly if they hesitate.
I think it's incredibly rude when people spring out of their seats and start unloading baggage in the faces of the aisle passengers when there's literally nowhere to go and the line hasn't moved yet. It's simple geometry that the aisle cannot contain everyone at the same time, so the people who do that must think that their personal standing-up is more important than anyone else's experiences on the plane.
Practiced travellers can anticipate when it's time to stand up (when three or four rows ahead start moving out), gather bags (when two rows start moving), prepare to move (when row in front moves), and get on their way. (Or the mom with sleeping kid option that also applies to slower or not ready person, i.e. clearly shepherd the next people on ahead.)
I totally agree that we're all uncomfortable and want to stretch out. Nothing feels better than the speed-walk on the cool jetway, yes. But the misery is just compounded if people are shoving by each other first, in the metal tube.