Since you have quite a few days visiting during winter and want to enjoy onsen; I suggest you investigate Wakura Onsen and Kanazawa. It's about 2 hours by train from Kyoto. Not bitter cold but you should see snow.

We stayed at a ryokan called Kagaya and it is very nice.