To be concrete, this would add 2.5-3h each way, setting aside the additional hassles/frustration? That's my guess, I've never driven from EWR area to JFK.

From there, it's up to you if that experience is worth the savings.