Niagara on the Lake is a must see - even if you don't go to the Shaw festival. It's a great little town, much of a british flavor (similar to Victoria, BC that way).

While on the US side, you're not far from the Finger Lakes area (with many, many wineries). Buffalo and Rochester both have some nice museums and galleries to visit.