The furthest I have gone with an infant is California from Wisconsin.
However, if I were thinking about traveling with our young child, a big consideration for me would be sleep. Jet lag is bad enough by myself, but with a toddler? No thank you! But that is me and our life situation, but it is something to consider.