Most of us probably don't hate babies. I love babies but don't really care to be seated near one for a long flight. Actually, babies can be quite good. It's their older siblings that can be real pains in the hienie. Especially when accompanied by inattentive, inconsiderate parents.
I DO make a point of complimenting well behaved children, and their parents, at the end of a flight or even in a restaurant.