I let people get out if they are clearly waiting to leave their row. No one needs to force a yield with me.
If they are dawdling I'm going to keep walking.
What I don't understand is why so many people find the need to block the whole aisle when removing things from or placing things in the overhead compartment. It's pretty easy to do from the aisle seat instead and lets everyone else keep moving.