Even in Callao/Arenales, if your window is closed and you turn on the ventilator/heating or a/c on, I think most noises will not be heard. I stayed on Santa Fe on a 5th floor apt during the winter and did not hear any noises.
I think being in the center and close to everything is worthwhile.