While it may not be against the rules, it's polite to leave young children at home when dining in a nice (expensive) resturant. There are plenty of resturants which are family oriented where young children are welcome and encouraged to come with their parents.