It's just how the rural side of Santorini looks like. That's the regular view on the island.

If you want to get sleeping in caves, take another hotel. It you want to have a real hotel and drive to the caves, take this hotel or the Cavo Tagoo, which is the only real hotel with a great view afaik.