Eger (by bus or train) is also a rather nice side trip from Budapest, as is Szentendere on the Danube bend.

Not that there's any shortage of things to see and do in Budapest, of course. It's a lovely city to wander round and relax and bathe in.