Hi,
THere are volunteer guide orgs that you could approach i.e.
https://www.tokyofreeguide.org/ if you let them know what you want to do they should find a suitable guide for you (as they are locals they should all know off the beaten path alternatives)