I'm in Olly now. Used the services of Cusco Transport, www.cuscotransport.com, for a one-way private trip from Cusco to Olly with stops in Chincero, Moray, and Salinas. I paid $100. Was well worth it to me.
The driver spoke reasonable English and provided some background info during the trip.