I see Naha to Yonaguni non stop from 17,400 yen, and Ishigaki to Yonaguni from around 7,400 yen, and Naha Ishigaki around 7,400 as well.
I think it price wise ends up being pretty much the same no matter how you piece things together. Just use the add flight option, and do it all as one booking..