My pet peeves:

1. When the doors open and the person waiting for the elevator has to ask "Going up?" or "Going down?" when the light panel clearly shows which direction the elevator's going. If I'm feeling snide I'll say something like "yes, see those lights there? When the up arrow is lit, that means it's going up."

2. When someone waiting for an elevator on the ground floor (i.e., nothing below you) asks "Is this elevator going up?"