Chick and Ruth's Delly [sic] is the classic place for breakfast in Annapolis. Lots of atmosphere. Try to get there when they recite the Pledge of Allegiance (8:30 weekdays, 9:30 weekends). Many menu items are named after Maryland politicians.
Yin Yankee Cafe has a pretty good pan-Asian menu, particularly the noodle dishes.