Including Colca valley? Yes, I think 5 days would be enough. 6 days? Maybe including the Majes valley (never been there), famous by its shrimps, pisco cellars, and witches legends. I've read there are tours that include this valley and Cotahuasi canyon, with stops in Pallarcocha lagoon, views of the Coropuna and Solimana snowy mountains, and some vicunas reserve, yareta flowers, etc.