OP was totally in the right. I can't stand these idiots who think they can control what another passenger does with their own seat. The seats recline, if you don't like it, don't fly in it.
I put mine up for meal time, of course. The rest of the time, it's up to me.