My two favorite chowder places are on opposite ends of the Earth: Seattle and Cape Town (well, Houtsbaai actually).
Seattle, the original Ivar's on the waterfront, right near the ferry docks. The chowder is divine, and the views of the skyline and the sound, with the ferries coming and going, make for a wonderful setting. Many happy memories with friends eating great chowder when we had nothing better to do. Their salmon chowder is particularly good, although their traditional "white" chowder is also very good.
Cape Town/Houtsbaai: first time in Cape Town I was alone one afternoon and just started driving randomly. I ended up driving along the beautiful Atlantic drive below the Twelve Apostles and kept going straight, until I finally hit the beach at Houtsbaai about 20 minutes later. There is a tiny restaurant at the end of the round, that serves some really good chowder and seafood. Again, the location (as well as the food) are divine. It was late afternoon in winter, with a golden sun beginning to set on the peaks and bay. The chowder was great. Shame I do not remember the name. Anybody know it?
Neither is particularly luxurious and fancy and neither will probably be listed in Michelin or Zagats or whatever. But both have something special, and the food is good. Great places, for great memories.