My absolute favorite is Angelo Brocato's
http://www.angelobrocatoicecream.com
214 N. Carrollton Avenue
New Orleans, LA
If you take the "Carrollton spur" of the Canal Streetcar line it a great ride on a the street car with a nice cool treat at the end!