Depends on how you are getting there. If by train through Penn Station, I think you're fine although depending on your timing and security at the airport, you might be a bit rushed. By taxi, personally I would leave more time just to be safe. But I also hate missing flights.

If you need to make this flight, you should leave earlier.