The whole point of having money is to isolate yourself from other people, isn't it? I'm not trying to be controversial, but the main perks of having tons of cash mainly include a big house away from others, airplane seats away from others (very far away if you go NetJets), a big car and big hotel suites (or, of course, your own holiday villa away from the rabble). You also get to shop in quiet boutiques and take a private taxi home. It therefore seems quite clear that those who can afford it have decided that constant human contact is NOT important.
Anyway, if the Rabbi has a house anywhere as near as large as the manse of the only CofE preacher I know (where you could play a full 22-man football game in his garden) then he is already more isolated from the public than most of us!
If, of course, he lives in a tiny one-bedroom flat in Streatham then I take it all back.