Basically what I'm saying is make time for a trek. I think your time would be better served this way than spending extended time in Aguas Calientes, Ollantay, Cuzco or Lima.
If you were going as a couple, however, my advice would be completely different.