I've had it happen before with people simply taking my seat. Not asking, but by the time I get to my seat, there'd be a couple there with one of them in my seat, asking me if I'd mind sitting elsewhere.
I'd be fine with considering a move if asked, but if you take my seat I'm not exceptionally motivated to do you any favors.