Since u're on a honeymoon, I would highly recommend a good traditional ryokan.
It would be more interesting than a regular hotel.

There are quite a few good ones to choose from in Kyoto, renowned for its ryokans.

Ryokans can run expensive though.