The only way I think you could do this is to make a new user group for each moderator, and name that moderator group after the boards the moderator works in...

Would be a few hours work for all the moderators and to me that would seem like too much work for a minor problem...