Had this happen a couple days ago. The lady was clueless about seat numbers, it was obvious because the FA reviewed her boarding pass and moved her across the isle.

If someone is recalcitrant about moving out of my seat, it's been a call-button event. It's easy enough to stand out of the isle while you wait.

All the best, James