I'm on both sides, as I've gotten noise complaint for conducting normal sound level activity too.
On the other hand, cell phone speakers are the worst. Even when they're not turned up, I can hear that squeaky sound frequency from the other side of the room, it's like jamming my brain and I have to stop myself from confronting that person.
If I'm trying to sleep in my room, I'll definitely be more upset than a lounge or public transport.