I would strongly recommend Cadaqués.
It's a very nice little sea side town. In the adjoining village Portlligat, you can visit Dali's house (which is every bit as surreal as you would expect it to be). Close by is the rugged Cap de Creus, where you can hike down to the sea and take a swim in a small cove.
Probably difficult to reach by public transportation, though.