There will likely be lots of plum blossoms plus other winter (esp. red camellias) and spring flowers to enjoy. Most Japanese castles are modern reconstructions. Some of the worst are hideous but some of them have cool activities for kids on the inside. You could investigate that. Also there are kid friendly museums in many cities—someone mentioned an example above—and those seem worth checking out as well.