I usually give $40 total on the set $35 taxi fare between YUL and the Fairmont QE/Downtown.
Word of caution: I kind of yucked up the cuff region of a few pairs of pants walking around Montreal in the slush and didn't have a chance to launder them during my trip. Use common sense in choosing what pants you'll be wearing for your walk.