Also, for interesting pictures...again, Tainan. No question. Kaohsiung, frankly, is an ugly blight of a city. Tainan is far more photogenic.
Taichung is a fun city to walk around, but is much more modern and has a better selection of international restaurants than Tainan or Kaohsiung. But Tainan has more traditional Taiwanese fare.