OP, In case you haven't gone yet:
We liked the Skansen open air museum in addition to the above recommendations. Also, I found the Skogskyrkogarden surprisingly interesting and moving. We rented a car the last day to see that and the Drottningholm Palace on our way to the airport, so I don't know about public trans to get there but I would be surprised if it wasn't easily accessible.