Is the boss using Outlook or something else? Or is she syncing between the two somehow? And which one do you want to silence, Outlook or the other one?
Off the top of my head I do not know of any way to make Outlook only play a reminder during business hours.