I wouldn't worry too much about it especially if you're in a newer building. I usually drink bottled water, but I do brush my teeth with tap water and haven't suffered any ill-effects. Our place is about a decade old and I'd have no problem drinking the water there. In an old building with old pipes and poorly maintained infrastructure, probably not.