The Toronto Transit Commission runs express buses (no 192) that connect to the subway ("ride the rocket!" - no worries about the traffic) - this is perfectly adequate even with a moderate amount of luggage, although for sightseeing it's obviously better without.

You'll need exactly $2.75 Canadian cash to get on, it's perfectly safe and will take you anywhere in the city center.