I don't know anything about bonsai or this bonsai garden, but for what it's worth my Saitama guidebook says it's considered world-famous and I also remember seeing this place featured on an NHK program (lot of foreign visitors apparently, and they were being interviewed on the program). As tt7 says, it should not take up 3/4 day visiting from Tokyo. If you like bonsai, you should go.