I know you aren't interested in the zoo, but the Omni Shoreham is a beautiful old hotel that I would consider at least near-luxury. Yes, you'd need to taxi / Metro anywhere. But they have a beautiful outdoor pool if you needed a day for some downtime.