Lots of nice things but it involves a fair amount of driving, but as you said.. you are aware it is tight.
Recommendation: On you tour of Cape Peninsula make a turn at Hout Bay for lunch at the harbor
On the way back from Oudshoorn take a drive back via Route 62 nice road with plenty of little stops along the way and some great scenery as well