I have noticed at some US resorts that after about an hour the resort employees will remove the towels which I think is fair especially because sometimes people do not remove the towels when they are finished.
It's really the resorts fault. They should have enough chairs for everyone.