I think a person has to know if he's irritating the other passenger. Everyone has the right for a pleasant flight. He/she wasn't doing it on purpose, he/she just didn't know. There's no harm in asking to cut it out in a nice, pleasant tone.

Crying babe, that a different story, you have to be understandable...