Brendamc, it sounds like you made things even worse by leaving early. You missed out on the dessert for which the restaurant is famous, and you waited for a taxi back to the hotel rather than the pre-arranged car service. If I were you I would have waited it out.

According to your description of them, a dress code would have solved this problem. No need to punish innocent customers with well-behaved children.