The folks in the exit row have a very specific critical function in helping to assure the safety of others- opening the damned door and not being distracted. While it is true that someone elsewhere could compromise safety as well (because of a kid in another row, panicking or just being a dingus), this is unlikely to have the same impact as a failure by the person who is supposed to open the exit.
And, by the way, I used to be of the school of "who really cares because we're all going to die anyway" until I checked my facts (with the help of good posts in prior threads similar to this) and learned that other things do happen.
Cheers.
Who is supposed to open the exit? All three passengers in the exit row (on that side)? 'Cause all the diagrams I see only show one person. Is it truly a team effort to open the door?