My vote is also for Taiwan. I am surprised someone thinks Taiwan is more expensive than Japan. I always tell people that Taiwan is a less expensive version of Japan where people are polite, friendly and helpful.
In addition to the sites mentioned by others, I would recommend Taroko Gorge near Hualien. With the highspeed rail, travel is fast and easy.