In the morning, make sure you take the Holland Tunnel. I"m normally cominig out of it into Manhattan when you'd be going in. Canal St. won't have much traffic and it shouldn't be too bad. The Lincoln Tunnel will be far more crowded/congested since one of the tubes is reversed.
Just in case, I would give myself a little more than an hour. When the tunnels mess up, they really mess up.