The int'l=> US and v-v transfer isn't active all the time. So yes, you will have to enter Canada outside these hours and there is no prioritized transit line (no secure corridor to int'l). That said, it isn't really that busy at that hour other than flights from the U.S. (IIRC, last int'l other than U.S. arrivals are late afternoon arrivals from TPE.)