Interesting - I travelled from Weybridge and had the opposite experience. 21 minutes door to door. I left a smidge before 3pm. Maybe I found the magic empty window, but even the high street wasn’t congested!
Or, conversely maybe it’s so bad further out no cars made it near the centre… but I didn’t seem to hit that.