The Little White House in Warm Springs is probably worth a visit.
There's all the Jimmy Carter-related stuff in Americus. The Andersonville POW camp is also nearby.
The Museum of Aviation in Warner Robins, Ga. is about a 90 minute drive east.
In Alabama, the town of Auburn is worth a visit. There's also the Tuskegee Institute National Historic Site, and downtown Montgomery is potentially of interest.
Of course Atlanta is within a two-hour drive and there's plenty to do there too.