My seventy-something mother managed just fine in Tokyo and she has arthritis and difficulty walking. The main problem she had was tatami -- she finds it very difficult to sit on the floor, so it's important to avoid some ryokan and traditional Japanese restauarnts. If you were to stick to Tokyo with side trips to Nikko and Kamakura, I think you would be able to manage a trip together with your grandmother.