If you can't understand the language that the commands will be given in, you should be moved. All good and well having instructions, but if the issue was for example an engine fire on the left hand side, the cabin crew might request that only the doors on the right hand side be opened. If you were looking over the aisle, saw the door opening and hadn't understood, you might just open the door and make things worse.
Appreciate this will possibly put crew in a difficult position. If the passenger doesn't understand what they're asked RE the exit door, they probably also won't understand why they're being moved seats.