I would not recommend driving to EWR at that time of day. Could be 45min could be 2+ hours depending on the tunnel. Take a cab or walk to Penn Station and catch NJ Transit to EWR. Very easy transfer. 4:17 and 4:27 NJ Transit departures get you to EWR with plenty of time to spare.