I find it rarely happens if you have the first few rows of the cabin as those are generally passengers with status. When it does happen, I take a lot of things into consideration.....how much time I have to de-board and get to where I need to get, how the person asked, who the other person is (ie. if it's a child, I will usually do it....it's not the passenger's fault that AC seated them this way).