I have no problem swapping seats if a person ASKS politely. It is when they demand it, or get the FA involved that I have a real big problem with it... and unless you have some medical condition that requires constant supervision, can't you and your wife be apart for the 45 minute flight from YYZ-YOW? I mean really... I have seen people cry in situations like that!
This past summer on a TK F flight from BKK to IST the FA said she would set my tray for two, so my wife could join me for dinner... to which my wife responded... "No Thanks... I have been having dinner with him for three weeks straight... why would I want to sit on a foot stool for an hour!"
I laughed and the FA just looked dumbfounded!
d.