If it's the almost-over-water landing that impresses you, you don't need to go to all the way to the Caribbean. The approach into LGA can get closer to the water than that.

Of course, there's no good plane spotting location there, except the adjacent island which is the NYC prison on Rikers Island.