You might be ok. Before my wife and eldest were silver I used to be able to guest my wife in as a silver and my 2 year old. He was about two and a half before my wife became silver and we no longer needed to ask.
We always used to be on the 9.30pm to DXB so I guess the lounge was quieter by 6.30 in the evening and the fact he was only just over 2 maybe helped.
Three times I went up by myself and asked politely and on all occasion they said OK. I think if you go up with everyone in tow it might work against you but if you go up by yourself and say 'I know this is not typically allowed and I don't want to put you in an awkward position but......' then you might be in luck.
If they said no I was fully prepared to say no worries and disappear off but perhaps they just couldn't say no to my charming personality and winning smile