As Atlanta is your first point of entry into the US, you will clear customs and immigration there. This includes retrieving your bag. If you had a faster connection you would then hand the bag back to Delta, but once through customs you're essentially out of the airport anyway.

Infact I'd suggest you wouldn't be able to get airside again anyway as your boarding pass would have the following day's date on it.