3 days will be tight if you really wish to explore. My wife and I did a very full five days and still hadn't "finished". We do tend to walk everywhere so that certainly added some time, but we saw sooooo much more.
We stayed at the Courtyard Vasilievsky Island, and loved the location - much more neighborhood-y.
Take as much time as you can muster. It's a joy.