One of my first actions every time I have to reprovision my BB is to change the notification settings. I set the default to be silent and "Level 1" messages to notify (either beep or vibrate). Then I set the option to tag high priority messages as Level 1. This basically means that normal emails don't cause any notification but something tagged high priority will. That helps a bit, too.