I am a pretty speedy driver and can match the Google Maps times in clear traffic fairly easily. However one can easily get stuck behind slow tourists for long stretches.

The biggest difference between the Google Maps times and actual times will be how many times you want to stop, detour, or take photos.