Depends on the airline, they might or might not enforce pax to seat arrangement.

I suggest you ask the FA nicely if you can do this once during the flight. But don't kick up a fuss if they say no.