Shelter Island 100%
Spent the past wknd there w/ my wife and another couple (were all in our early 30s)

Near the Hamptons but NOT the Hamptons. Accessible via train or bus if you dont have a car. Close to the North Fork Vineyards. Quiet and quaint with a few nicer bars/restaurants if you want to go out.