When I did overnight (10+ hours) at EWR, I was asked at check-in counter at IAH if I want to check my bags all the way or just to EWR.
(I opted all the way, since I had carry-on for overnight, and didn't want carry big luggages at EWR.)
So you can choose - just tell check-in agent the way you want.