I see lots of these going to E fares.

Remember that a major priority for GAs is just to fill whatever seats are available and dispatch the flight on time. They're not going to poll the whole gatehouse to see who wants what seats after UGs clear.

If you are eligible and want the seat vacated by an UG, asking the GA ahead of time is the best bet.