If only you are flying J and the other are in Y then you would need 3 guests, since 2 of your kids are over 2. By the rules you only get 1 guest, so by the rules no you cannot guest them all in.
There is a possibility that the lounge guardians show any dis cretion on the day and make an exception. But if you do ask and they say no its understandable.