Perhaps the people who aren't walking have a blister or a bad knee or are exhausted from travelling for ages. All you have to say is excuse me and they will let you by.