If your idea of a good time is running around the streets and getting fall-down drunk, the French Quarter will be perfect. A better option (IMHO, of course) is going to see live music. Galactic at Tipitina's on NYE, for example, will be great fun.
Public transportation is ok but not great. Don't rent a car though. Use uber or lyft or taxi.