I would concur that one should not walk around the neighborhood at night. We didn’t experience any problems during the day, other than the occasional beggar, which one can encounter anywhere around Cape Town.
The first time we went to the ATM at the Mini Mart across the street we asked the doorman from the hotel to go with us. After that, we did it on our own, including my wife, solo, several times. No issues.