I drink bottled water or water "from a machine". For everything else (teeth etc), I don't care.

For about a year, I merrily drank water from a tap in my flat in Chungho (Taipei suburbia) thinking it was supplied via some kind of osmosis device. Turned out it wasn't. No noticeable ill-effects.