Years ago, I used to stay at either the Swakopmund Hotel (a converted railway station property with a casino), or the Hansa hotel.

Avoid Walvis Bay - on days when the wind direction is off, you get to smell the fish processing plant. Not pleasant at breakfast time.

Also, pack something warm - when the fog rolls in - even when it is summer, it does get cold.