I'm unclear on your objection. Is it that you are concerned that this is a rule violation, and, perhaps, a safety threat to the plane's communications? Or is it that you consider it rude for the guy to be yaking away next to you so much?
I can't sympathize on the safety issue. It's becoming clear that there is no safety threat for someone to yak on their cell phone after push-back. The only threat is to the airphone companies' profit margins.
Would you have a gripe if the guy used the airphone in the same manner?