If you have four or five days you should at least go as far east as Knysna and Plettenberg ( a short distance from each other).
Inland a bit, we enjoyed the small towns of the Little Karoo - some of the passes in Johan's link aren't off the beaten track and are on good roads. Cogmanskloof, for example.
http://www.mountainpassessouthafrica...,-montagu.html