I would encourage you to visit the state dept. office and getting a same day passport.
Flying or driving, border officials are always on the lookout for baby smuggling and you might have a hard time (or you might breeze though) but with a passport you are assured that any delays will be minor, as opposed to the type that could wreck your whole trip.