As others have said, there must be some in Relais & Chateaux. I'm traveling now and cannot thumb through the book I have at home.
But off the top of my head I think the famous 5 star in Carcassonne Hotel de la Cite might be one for you.
http://www.accorhotels.com/gb/hotel-...#section-rooms
It has a 1 star restaurant as I recall and it has a private villa. But I don't think you will find any information about it online. I called the hotel directly and asked to book for seven people and they suggested their private villa and emailed me some information about it. Sadly my plans changed and I must have deleted that mail. But give them a call. If you like history, it's a must visit. And there are several other Michelin restaurants nearby.