I will be in Taiwan in August too. My Taiwanese friends here are feeling sorry for me already...in terms of language barrier.
I am Asian, so it sucks even more, because I blend in. If I was white or black, at least they would know I am a foreigner. And maybe assume I am English speaking and the ones who wants to practice their English would help me, if for example, I look lost and looking at a map - I know a lot of my friends have had this experience first hand. It's the same when I am in Japan, but at least I know a lot more Japanese than Mandarin and I can get by. I can only speak Cantonese.
When I was in Spain, I went to a Chinese restaurant, of course, ran by Mandarin speaking Chinese...I had to speak Spanish to them!! That was bad.. I think I should learn some Mandarin..
Taiwan is famous for its Night market. The biggest one being Shihlin market. Just go there, walk around and try anything and everything..