In large airports there are limitations on early pushback. It's basically up to the ground controller. The Captain just can't close the door and instruct the ground crew to begin pushback. The crew would probably love to do so as they could be home or to the hotel earlier or have more time between flights.