The Old Court Inn is supposed to be nice. I've never stayed there - I'd only been inside a handful of times to drop off rent checks to a former landslumlord.

It's located in a historic neighborhood, walking distance to most areas of interest.

http://www.oldcourt.com