The trains to that area of France depart from Gare St. Lazare.
Yes, Gare St. Lazare. For some reason, (maybe heading north from Paris?) I had Gare du Nord in my head.
The rest of my itinerary still works, for a (long) one day trip to Normandy. It is doable, if one isn't willing to take a full night away from Paris.