The train is a relaxing and pleasant way to arrive alive at your destination.
The train station in Hua Hin is a historic old wooden structure worth seeing in my opinion.
I would forsake an hour or two and save some Baht for other expenses. The subway in Bangkok will take you directly to the train station. Easy.