4 days in Yakushima should be great. If you're going to be doing a lot of hiking and outdoors activities, I highly recommend Yakushima Geographic Tour company. We used them and really enjoyed the personalized experience of a private tour guide. Cheers