I also discovered this company which does transfers directly from Walvis Bay to/from Windhoek: https://www.carloshuttlenamibia.com´. Unlike the Swakopmund Shuttle, which has a single departure point, this bus will pick you up at your doorstep.