Yep I would drive to Madrid. You can always drop the car off at Barajas and taxi into the city. But I wouldn't make any reservations along the way. Just stop in whatever city or village interests you and inquire about hotels. If you aren't in a big city, the hotels are quite cheap throughout France and Spain. Maybe head to Bilbao and the Guggenheim? Or Provence?