Drumheller is the other side of Calgary from Banff, and warrants at least a full day there (my first and only visit there was when the mueum was in its infancy in late 1970).
Icefield Parkway between Banff and Jasper you want to do in both directions ideally, so need a night in Jasper. Road is likely to be slow and busy to make it a same-day trip.