November should still be fine--early in the month.
Bermuda is a lovely spot, but, speaking from experience, I was never so miserable as the winter of the year I lived in Bermuda.
It was not that the weather was so cold--after all, we had come from Montréal. It was that is was damp, cool, and the houses were not properly heated or insulated.