Did you ask the crew to keep the noise down or did you speak to a Purser or the ISM? While it should not have happened in the first place, if you had asked them to keep the noise down and they didn’t then that’s a different matter. While FAs should be considerate of their passengers comfort if they don’t know there’s a problem then they can’t address it. On occasion, I’ve been in similar situations to you in both J and F and I always say something along the lines of “I’m trying to sleep, would you kindly keep the noise down”. Every single time, the crew member/s look mortified and almost every time the ISM comes to me later in the flight to apologize. They can only learn from their mistakes if we point the mistake out to them.