Hmm... maybe the timing of your visit with a 2 year old isn't ideal. November can be pretty bleak and cold.
Of course, Montréal is a great museum, food and nightlife city, but the kiddo will not be into that. And what the kiddo likes (strolls in the old port, paddleboating on Beaver Lake, public playgrounds with splash zones, street performers etc.) is limited to summer months.
At the same time, there likely won't be snow yet for tubing or tobogganing.
Any chance you can reschedule?
Either way, within the downtown area a car is much more of a hassle than an advantage. Public transit and Uber are the way to go.