I spent 2 weeks in CPT and stayed in Sea Point, Bantry Bay and V&A Waterfront.
My order of preference was BB, SP, V&A. I was told not to stay downtown by many people and glad I didn't.

I had a car so it wasn't an issue, but the night going out and drinking the 20min Uber ride was like $5.