You can get from Matsumoto Castle to Hirayu Onsen and Takayama via Nohi bus. Takayama's got the old town flavor with plenty of cute shops and morning market. It is also known for Hida beef. Hirayu is a quiet small onsen town without cement high rises. The only shopping I saw was a large rest stop and produce stand.
http://www.nouhibus.co.jp/english/matsumoto.html
It you go to Hirayu via bus and want the ryokan to pick you up at the station, you should pre-arrange a time, rent a domestic cell phone, or make an international call. There's no public phone at the rest stop. The town is small but it snows a good bit & doesn't have a lot of sidewalks.