That's a wise advice. That's the usual schedule people do.

There are "horror" stories everywhere, from Cusco to Amsterdam. You just need to be careful. Of course it's easier for spanish speaking people, but Cusco is not that dangerous. If you feel afraid the best way is to reserve a hotel with transport from the airport (Casa Andina hotel, etc.). There are several agencies you can find at the web that offer secure transport.