Under FAQ's at EZPASS this is listed
https://www.e-zpassny.com/en/faq/account.shtml
I don't own a vehicle. Can I still get E-ZPassŪ? Yes. If you do not own a vehicle, you can still enroll in E-ZPassŪ. Your tag can be used in any vehicle with two axles, a maximum gross weight of 7,000 pounds and single rear tires (includes RV's with dual rear tires). Please ensure that the E-ZPassŪ tag is mounted as per the tag installation instructions in all vehicles in which the tag will be used.
So it looks like you can get an EZpass without actually owning a car. Seems like this would work for a foreign visitor.