The issue with water in Taipei/Taiwan is that generally the pipes are not good enough to be pressurized. So, most buildings have a water tank on top of the building and each building pumps the water into the tank.

The water that leaves the water company safe enough to drink. Once it goes through the tank, who knows.

The current worry here is norovirus. TaipeiPeter's advice is sensible.