Removing others' dishes before everyone has finished is, in my book, one of the rudest things a server can do and immediately means a halving of the tip. However, I do recognise that in the USA they seem to be trained to do it - so I only halve the tip if they continue to do it after I've told them not to.
Of course, real etiquette is for the faster eater to slow down so as not to pile pressure on the slower eater....