I went to Stavanger for work a while back and in fairness it was a bit underwhelming. I have to say it was a miserable work gig so that might've scarred my memories, for I also was in Alesund and hated it wholesale, but that was definitely because of work. As for slow travel... then I'd really really really recommend the train journeys in country. I did Oslo-Bergen (6 hours) and (Oslo)-Trondheim-Bodoe. It was amazing. vy.no is the website and their prices if booked in advance can be cheap.

In fact if I were you I'd give Stavanger a miss, go to Bergen and then head over North. Lofoten islands are also very promising, though I've never been there. I mean, they feature the village of Å and a small island called Skitenflesa (Sh*t rock). Plus some incredible views, and orcas in the right times.