As a typical American, I am accustomed to the freedom of having my own car, but I was delighted to part with it in Vancouver - where the Canadian line took me from YVR into town and my transit day pass (which I bought at the 7/11 in the airport) allowed me to use buses and ferries. I really didn't need or want a car in Vancouver, because mass transit there is THAT good. I stayed at the Sheraton Wall Center, which was quite nice.
If you want to use a car to visit areas outside Vancouver, you might want to stay outside the downtown at a hotel that has cheap parking and access to mass transit. Vancouver itself has no freeways in downtown and great transit options.
Toronto is another place with excellent transit options. We stayed at the Toronto Hilton, which was right on the Red Rocket and an easy walk to the train station. Take VIA Rail to the falls, avoid the traffic and partake of the vineyards and the wine tastings and enjoy the falls at night. Take the last train back to Toronto, and stay at a hotel within walking distance of the train station.
There's plenty to do in downtown Toronto, which is walkable, but remember Toronto is a city of neighborhoods. Someone on this site recommended a restaurant called Le Paradis to us. It's a couple blocks from the TTC stop in Egington, has a sidewalk cafe, is reasonably priced and the food was wonderful. Toronto is full of places like that. Traffic can be crazy bad, especially on the Gardiner, and I've never felt like a wanted a car in Toronto.
As far as your western B&B's, I can't help out, but I'd certainly take my time going through the Rockies and the high desert in BC. Life is sort of like the road to Hana. Hana's a nice little place at the end of the road, but the drive getting there is the best part. By far.
Enjoy the journey.