When I was in Bergen, we took the funicular up the mountain and walked down--the best of both worlds.

If you are into classical music (and its sounds as if you aren't, but one never knows), the tourist information center has a list of concerts held in the small theater on the grounds of Edvard Grieg's home. Buy a ticket at the tourist information office, and it includes bus transportation there and back (it's out in the suburbs, so too far to walk).