I think wearing a mask to prevent yourself from getting sick or to protect others when you are sick IS a good idea.
It may be uncomfortable at first but you will get used to it. Avoid touching objects that are not cleaned consistently or easily (basically most things on board or at the airport). Wash your hands constantly. Hand sanitizers kill bacteria but not viruses.
When I fly during the flu season, I even bring nitrile gloves. I may look odd to others but it's better to look odd than to get sick.