Get into the habit of removing them as soon as the trip is over. Before the glue has a chance to dry out they usually peel off very easily.
In some of the previous threads about it, people have said you can ask they put them on your boarding pass if you prefer not having them on the passport, and some others have a clear plastic cover for their passport so they don't worry about it at all.