I've never been bothered by this myself EXCEPT when it then results in the FA ignoring the other passengers and their job to focus on their target.
Usually this problem is more with the FAs friends / co-workers going home, to work, or on vacation though.