Last Thanksgiving day it took an hour with very few people in line ahead of me. I was in BF so one of the first off the plane. I had no checked luggage and barely made my next flight (note the originating flight was 1 hour late).
So I would say it varies, but then again I xfer through EWR only 1 or 2 times per year. That last one stands out in my mind due to the low loads and the long wait time in line. Perhaps it was an anomaly.