See... this has me torn.
In WTP, it's more of an issue if that person ends up in front of you or behind you. If you've got an empty seat and suddenly someone who isn't mean to be there is reclining that seat; I think you have a right to be aggrieved. Same thing applies to someone behind you grabbing the seat back as they get up and down, etc.