That is a very interesting question - while I have to admit that I have never thought about flying from that sort of a perspective myself.

Obviously there is always risk involved with flying from A to B, and perhaps the risk varies by airline/ aircraft type / time of day etc etc. In order to answer your question properly, we would need help from people involved with aviation safety as well as statisticians.

However, I would recommend you consider the following things first:
(i) is it necessary that all members of your family travel to the same destination?
(ii) is it necessary that all members of your family use the same method of transport to reach your final destination (provided that you all need to go there)?

At the risk of making a mistaken assumption, I would say that the risks involved with your trip to the airport exceed the risks involved with your flights. For this reason it is of utmost importance that you will travel separately to/from the airport.

Safe travels!
okko