if all passengers are loaded and there aren't any excessive means used to achieve that then I see no problem in trying to leave early though sometimes you will be held back to manage the slots at the arrival airport. I have been on the odd flight where they have tried to speed things up because weather was closing in for example and an early departure is way better than a cancellation!
As to how early the arrival is well there is a little schedule padding involved too.