It's also possible to get your own E-Z Pass to use on this trip and subsequent ones:
https://www.e-zpassny.com/en/onthego/locations.shtml
Whether it makes sense to get your own depends on how many toll roads/crossings you will traverse, and whether you will have future use for the transponder.
If you will be using Port Authority bridges or tunnels to cross the Hudson River and there will be at least three of you in the car, getting your own transponder and signing up for the (free) Port Authority car-pool program will save you several dolls on each crossing.
If you simply use the rental-car company's transponder, you will be charged the full, cash toll everywhere, in addition to being charged a daily "convenience" fee for every day of the rental -- even if you only use the transponder just once.