The Seamen's Inn is great. But my favorite place to eat in the area (and I lived there for four years) is Paul's Pasta in Groton. It ain't fancy, but there's a view of the Thames river and the prices are exceptionally reasonable.
And check out Rosie's Diner in Groton for the experience. Tuxedos, Truckers, and everything in between.
Good luck at the craps table.