I've never paid more than $30 to rent a car for this trip, from Avis. Likewise EWR-LGA or EWR-JFK. I've probably done all of these journeys 50 times each. 1,000 VS miles included (that's 3 cents / mile for the MR folks - with a free car thrown in)

, and no suicidal NYC cab drivers to deal with

Like I said, it's not the only way - many people wouldn't be happy driving the maze of roads between them.