Does anyone ever make the trip in the opposite direction from Kyoto to Hakone then on to Tokyo?

I am taking the train from Tokyo to Takayama for the festival so there is no time for Hakone on the front end of my trip. From Takayama I go to Kyoto for 5 days and this cannot be changed. I am wondering if it is feasable (or makes sense) to take the train to Hakone on the way back to Tokyo. It would be just for one day.