In Atlanta, besides the location at Crown Road, the Forsyth Street Post Office downtown (near the greyhound station, the city jail, and the Garnett MARTA station) is open until 8pm during the week.

If you ever want to know hours and locations for USPS simply call:
1-800-ASK-USPS
(1-800-275-8777)