Do the seat "poachers" try to take a seat that is assigned to someone else?
If so, then the FA's are entirely within their authority to enforce it. However, if the passenger who has the rightful assignment doesn't care, should the FA act in that case?