I've done this before AFTER meal service in F so I could sit with S.O. in Y and FA's didn't care, all they said was once the switch is made, can't switch back. Of course the random passenger in Y was more than happy to make the switch.