Most people do not walk from their hotels to see the sights - you get a car and driver - so I have never been too concerned that Rajvilas was out in the sticks compared to, say, The Rambagh Palace, which is much closer to everything. The Rambagh is a lot fresher than Rajvilas as it was re-done more recently. Rajvilas was the first of Oberoi's Vilas hotels so the design of its accommodation is showing its age. Did you not dine in the cooking school there, where they do excellent thalis?