I'd say your freedom ends where the other person's begins and vice-versa. If reclining your seat is going to impinge upon the person behind you, then you shouldn't recline. Similarly, if you're not reclined, then the person behind you should not be hitting/kicking/resting upon/bumping your seatback.
------------------
Time..... is on my side.