It's the opposite of fancy, but depending on your conference's location, Mother's on Poydras Street would be "a real New Orleans experience" as well as a good and inexpensive place to visit for breakfast or lunch, especially if you want to save up to splurge once or twice.