I don't think there are any places along the Garden Route which are unsafe. I don't know when Odysseus was last in South Africa, but - although there are certainly areas of the country where you'd want to be careful - the Garden Route is not one of them. In fact, some parts of some of the cities are the top places to avoid on safety grounds.
I haven't actually been out of the cities in South Africa so I am glad somebody can give more accurate information.