<font face="Verdana, Arial, Helvetica, sans-serif" size="2">Would the noise be much in seats 35-A/B/J/K too?</font>
Depends on the specific baby

I had a perfectly peaceful flight in 35G next to a sleeping baby last year.
However, those are among the very best seats in a NW 744, apart from the difficulty in seeing the screen.