Your lap child probably infringes less on the other passengers personal space up front than in closer confines of E+. Many elites are flying E+ these days anyways. But perhaps those other elites who got upgraded after you declined enjoyed F more than your children would so that was nice of you.