Yeah, those milliseconds saved by finding a faster DNS add up, at the end of the week you may have saved two, maybe three total seconds.
I never touch mine, it takes more time just to download and install and run namebench or any of the others out there than I can possibly save in a year of a very slightly faster dns.