Day of the week is key since you're clearing both Canadian and US customs. Weekends are the worst for time since it's cruise ship arrive/depart days. Standing-by may be problematic in general unless AS clears you before US customs -- how do you get "back into Canada" if you don't get on your flight? Crossing this border is much more "official" these days.
The on-site Fairmont is an overnight alternative.