If you are there on a Friday, the best choice has to be Galatoire's. It has wonderful food and the local social elite have Friday lunch there. It makes for a great meal and it's fun to watch the interaction between the tables.
Note that Galatoire's doesn't accept reservations and everyone (and I mean everyone regardless of celebrity) stands in line to get in. Jackets for men are a must.