My passport is very scrappy looking due to just plain wear. There are air bubbles around my photo. I've never had a problem leaving the US or getting back in -- but I have gotten additional scrutiny trying to get into and out of countries, particularly in Asia for some reason.
I keep meaning to get a new one, but I always have another trip around the corner that I need it for...