I thought about this more - disregard comments on car.
Your best bet from your hotel is walk over to Port Authority and take the express bus (if you time it correctly).
It makes no stops and outside of timing the departure same velocity as a cab at lower cost.
http://www.coachusa.com/info/coachusa/ss.351express.asp