My experience has been similar to those noted above, I have had flights cancelled many times when there is a light load but it has usually been on routes with frequent flights (LAX-SEA). My experience has been that it is very clearly done for yield management, I can't count how many times they have cancelled my flight or the flight before mine for a "mechanical" and by strange coincidence they have been able to accommodate the passengers from both flights on one plane.