+1 Look for a hotel near the elevator to subway/JR if possible. The elevators are on the Tokyo subway station maps. A well located hotel near a well connected subway stop with elevator is a good investment.

As for the eating in public, not Japanese, but if the options are a child parked on the side of the street is having a snack vs a child having a hangry melt down with frazzled parent, I know which one I'd prefer to briefly encounter. I have seen a Japanese kid in stroller have a melt down on the sidewalk and a not great reaction from his mother. It does happen!

It might be worth working on "indoor" volume & neighbor friendly habits with your toddler if you don't live in dense housing. Shinkansen are pretty quiet.

Nevermind.
But I will add, make a list of expat medical clinics. I find they are useful and better than ending up in thr ER. But I have an international SOS membership.