Did my newbie trip last summer, and asked a similar question. Had several suggestions, and the one we liked best was a pleasant little French restaurant on Bedford Road in the Eglinton neighborhood called Le Paradis. The sidewalk cafe was perfect for conversation. The food was quite good and prices were very, very reasonable.
It's a short walk from the Eglinton subway stop, and we found the TTC to be quite interesting (compared to what we had here in DC), and it's fascinating how the city's outlying neighborhoods have developed along the subway (Eglinton was where it first ended....now there are numerous additional stops along Yonge Street).
Toronto boasts being a city of neighborhoods, and we greatly enjoyed the contrast between downtown and the outlying neighborhoods, which can be very much like small towns, with main streets, a library, a post office, a park, etc;
Downtown TO is fine. But you might enjoy getting out to some of the neighborhoods. Enjoy!