If a passenger in E- moves up to E+, somewhere other than the seat next to me I feel it's the FA's issue to deal - or not deal with.

But I think the Op and I believe that if they plop themselves down next to me in what should be an open seat......I will go right ahead and question the person... "I don't think this is your seat"...and get the FA if necessary.