My worst experience entering Canada was when I had my two older children (mid-teens) with me for a long weekend using frequent flyer miles. Canada immigration was virtually apoplectic that I didn't have a letter from their mother (we are married and living together) allowing me to take them out of the country. I had never heard of such a thing -- certainly not for kids that old. Canada acted like I should have known and was seriously planning to send us back.
I suggested that they just call my wife and have a conversation with her, if that would make them feel better. Making the offer seemed to do the trick. They let us pass, but said never do that again! I haven't.
Bruce