First of all, when are you traveling?

If it's the summer time, and you got time to spare, sailing is a nice option to check out the scenery along the Danube. But if you are short on time, just take the OEBB railjet. Budapest is a beautiful city, and you will love it just by walking along the river on both sides.