There are other options that lie somewhere between a taxi and a floatplane

The YYJ Airport shuttle has a direct and convenient service from the airport to several hotels in downtown Victoria including the Hotel Grand Pacific which is directly across the street from the Black Ball Ferry Terminal (where the Coho from Port Angeles docks). The frequency of service varies depending on what time you arrive, but there is one that departs YYJ at 3:20 pm and one at 4 pm, if I recall correctly. The price is about $25 (CAD). The link is: www.yyjairportshuttle.com. BTW, YYJ is a small (and efficient) airport so you won't have to wait long for your bags. Usually I have time to make a quick bathroom stop, and then my bags are there!!

P.S. If you get downtown before your husband, the area around the Hotel Grand Pacific is a great place to while away some time. PM me if you'd like more info about stuff to do. I spend a LOT of time in downtown Victoria so I have a few ideas