Beacon Hill is definitely a must-see if the weather cooperates. Also, the Back Bay was developed later in the 19c and is important to walk through as well.
I'm not a big fan of Downtown for tourists because of the traffic and the Big Dig. But on a weekend morning, if the weather is nice, it is worth doing the Freedom Trail through Downtown and the North End.