I think this is your pet peeve, so you are looking for an excuse to have it bother you more than it should. You categorized the passenger as giving an "unapologetic sorry". Again, your clouded perception. The recline in the seat in front does not affect the tray. How much seat pitch did you lose? One inch? Recline your seat and regain that inch.
I am not a psychologist and my comments should not be a substitute for psychological advice.