I give the squatter one chance. People do make mistakes. But, if it's a seat assignment I care about, I just hand it off to the FA and tell them that there's someone in my seat and I'm not interested in the seat he wants me to move to.
Needless to say, there are occasions when I've done better by a swap, but not many.