I see both sides to the taking the plate away scenario. I hate dirty plates in front of me when I've finished eating, so I don't mind a waiter asking if it's ok to remove my plate (vs just taking it w/o asking) or, if the waiter is waiting for the entire table to finish before removing plates, I might motion the waiter over and say quietly, you can take my plate away. I've never noticed my breakfast, lunch or dinner companions feeling they needed to rush through their meal because my plate was taken away.
I do find it irritating when a waiter starts to take away a plate (w/o asking) when there's still food on it & you have to say excuse me, I'm still eating. Doesn't happen often, but quite annoying when it does.
Cheers. Sharon