Just as a follow up to my initial post/question.

There was no problem getting in to the lounge with my wife and both girls. No one mentioned paying an additional fee. We used the Maple Leaf Lounge in the Toronto Infield Terminal as well as the lounge in Terminal 2 on the return. We also used the London lounge at Heathrow with no problems.