Bermuda is not the Caribbean and has a quite different climate pattern. If you want warm weather you need to go between April-October. The sea warms up a bit later than May. I'd say the best time for a visit would be July-Aug and then September despite the risk of a hurricane. It's a most inconvenient place, really, weatherwise.