I prefer the mini-vans that leave from the Victory Monument. Fare is around 200-250 Baht per person, and they will definitely stop in Cha Am if they have passengers going there. They depart every half hour or so
http://www.tourismhuahin.com/minivan-huahin.php