If Victoria is a must, you might want to consider one of the float plane services (i.e. Harbour Air). It will set you back a bit (starting from $110 each way) but instead of a 4 hour journey via ferry you do it in a 20 minute flight. Plus, if you're staying at the Westin Bayshore, the downtown Vancouver float plane terminal is just down the street, and in that case you could do Victoria as a day trip and not have to stay overnight.

On the drive to AB, I personally like the Fraser Canyon route (Hwy 1), though it does take a bit longer than Hwy 5 (but not as long as going through Whistler). Once you get to Alberta, the icefields parkway (Jasper-Banff) is a definite must do. After that stay in either Banff or Lake Louise and visit the other, no need to stay in both as they're only a 40 minute drive away. Choose Banff if you want a bustling town with lots to do, or Lake Louise if you want to be a bit more secluded.