I have always considered it the right of the person infront of me to recline, by the same logic, it would also be right to recline as well. I haven't really thought of it any other way until now probably because nobody complains when I recline and since I do it politely (Ie. Pushing back slowly, unreclining at meal times or if I hear they are getting up)
In response to those who complain about recliners: I must say that if you aren't willing to pay, with either miles or cash, to fly upfront, then you should except the fact that economy is cramped with pax who have been given the choice whether or not to recline by the airline. Ofcourse your complaints about unruly/insensitive pax who recline during meals is totaly justified but I just cant seem to see the logic that since you need to use your tray table to work, the pax in front of you can't use his seat to rest.