I imagine season affects swimmability from the OWVs. Ive seen YouTube videos of people swimming in calm seas there.. We were in 105 in June and swimming was a no-go from the room. It was usually pretty choppy. But...snorkeling off the beach behind the dive center was pretty solid and far calmer. I would just check in with the Dive center for guidance when you're there.
Also, if you have your own gear, I might consider bringing it. They have free stuff, but my snorkel took in a bunch of water when we we're out on a trip and caused me some drama. Had I brought my gear, I might have been able avoid that.