I had the elevator barger before. I usually just stand in the middle of the doorway and say something to the effect of "It's traditional to let people off the elevator before trying to enter." They usually back off and let people out. Works the same for trains, and public transit.