End of April is a good time to visit the Hamptons and twin forks (north & south) of Long Island at the eastern tip and can be reached on LIRR from Manhattan and Jamaica (transfer to/from JFK's AirTrain) if you do not want to rent a car in the city - a drive of 2 to 3 hours from the city, depending on traffic.
The oldest lighthouse in N.Y. is out at Montauk Point, and boats going out to the surrounding waters of Long Island Sound with a variety of marine life including Finbacks, Minke and humpback whales, dolphins, porpoises, seabirds, sea turtles and many species of fish.
Nearby Sag Harbor has nice & historic restaurants serving fresh seafood & all, prices comparatively good vs. NYC - and choice of charming inns, seasonal motels & chain hotels at varied prices (bargain vs. the warm summer months & still good over NY city's high rates. Oysters, clams, mussels, shell fishes and other products are avaiable fresh from the fishing fleets - perfect to go with your own bottles from the local wineries. Google searches will yield many links & info.
And, there is Tanger Outlet Center with 400 shops at Riverhead, NY including premium/designer brands like DKNY, Coach, CK, Polo RL, Giorgio Armani, and many others.
http://www.tangeroutlet.com/riverhead/area-information