It's no different than escalators -- stand to the right, walk to the left.
Now if someone's disabled or looks like they've been stuck in Y for the past 20 hours, I'm willing to give them a pass. I've been THAT traveler before and can completely sympathize.