Can't help you on experience, but would agree with previous posters that pick up in the city centre should be your last resort. Even for native drivers, Edinburgh is just a horrible place to drive - the roads are mainly fine, but it is snarled up traffic, one-way streets, trams, etc.
I don't know how popular Volvos are your way, but we drive an XC40 (one size down from the XC60) and find it very well sized by U.K. standards.