Well neither the Admirals Club nor the RJ lounge are BA lounges as such, so perhaps this would be better asked on one of those sections of FT, particularly as you're travelling with RJ and not BA anyway.

As far as BA are concerned, if the toddler is under 2 then they will normally be allowed in the lounge with you. Over that and the answer is no.