Considerate people will grant custody of the armrests to the middle seat. However, this is not a "rule" and it is not known by "everyone." And if some clod thinks they have to claim both of their armrests, or part of the shared armrest, there's not much that can be done about it. (Because there is no rule.)