I wouldn't do it. Your trip back to YOW from downtown will be in traffic, and Thursday afternoon/evening is consulting central at YOW (i.e. busier than normal with consultants heading back home for the weekend), meaning you'll have to get there earlier than normal.

That's just my opinion though. Good luck.

P.S. I don't think there's anywhere at YOW to store luggage