Last time I was in Vienna (summer), I did a day trip to Bratislava by hydrofoil on the Danube. Though the scenery was not particularly varied, the ride was quite pleasant and probably nicer than by train.
Bratislava is indeed very cheap but also very small, I would not base myself there, so much more to see and do staying based in Vienna.