Unfortunately if a passenger does it AFTER the crew are on the jumpseats then there is no way of being able to tell them off. Now at an emergency exit a crew member should be there by the door regardless so it was either the crew member was new and didn't want a confrontation or the passenger was HVC and the crew member didn't want a confrontation because either way they'll be on the losing end of the stick.
Wrong though unfortunately.