This is not true anymore - with the re-alignment, much of Saddle Rd is perfectly safe and comfortable to drive, and one only needs to pay attention on the Parker Ranch side which is re-paved, but not widened/flattened. A Saddle Rd newbie should avoid rush hour periods and they can pick their way across the Ranch side without incident.

If the OP wants to use ITO to get a lower fare and drive to the Kohala side asap, Saddle Rd is the best bet...but if they want to arrive ITO in the morning and take the day to make the drive, I would take the northern route, stopping at the various falls, Waipio Valley, etc., and arrive Kona or Kohala around dinner time.