It's very easy to get into the mountains - Couple of hours from Tokyo and you can be in some very green and pleasant spots. If you really hate cities, you probably end up going through one at the start and end of your visit, but you needn't spend more than the time it takes to change trains.

This site might give you some ideas
http://www.outdoorjapan.com/