Location of Manhattan - Huge difference.
To be fair, it also depends on your hotel and your final location in Manhattan. If you are in West Manhattan with only minutes after getting off the Jersey-NYC bridges, then EWR can end up being even faster. Everywhere else in Manhattan it would be either JFK/LGA.