I've never had a single issue with children in lounges or on planes. Sat next to a mother with an infant in a bassinet once and no real issues there.
As with others here, it's the "walker talkers", "loudmouth business callers" etc. that are an issue. Had at least 3 within 30ft of me in GF the other day (2 of them seemed to be developing software for the same company, but were unrelated).