I think it's less about "being a jerk" and more about "it doesn't really work to begin with." The only people who can drive a benefit are either groups traveling together and all in the same row and stay seated as a group or people in window seats. But if I'm in the aisle seat and the window or middle seat passenger needs to get up because they have a tight connection, once I stand up to let them out, it's just as fast for me to grab my bag and just go versus maneuvering around to try to make space for them and getting back into my seat just to create the illusion of making it faster. Throw in additional headaches if those with tight connections are having to swim against the flow to get their stuff several rows back because overhead bin space was out above their row when they boarded.

What would speed up the process is if more people would be ready to go when it's actually their turn instead of loitering until the flow finally opens up.