Jewish Quarter
New York Cafe in District VII has fabulous art nouveau architecture. But really Budapest has a wonderful nightlife and lots of bohemian restaurants. Exploring by foot is recommended. While I am happy to recommend a non professional Hungarian guide, its not really needed - as others have suggested.