When we stayed last April we were on our honeymoon & just wanted to relax, so we stayed on property the whole time (8 nights). We loved it and honestly didn't get bored, but relaxation was all we wanted. We lazed about, ate, drank, swam, read, watched TV in bed, got massages, etc. We had a swim-up room and absolutely loved it. We would spend hours going between laying on the lounge on the patio reading & in the swim up pool.

That said if you want action & activity, or to experience local culture, you'll probably want to leave the resort. I don't think there's much in the area (though we did also hear great things about Scotchie's), so you'll probably want to book tours or take a ride into town.

Edit: I would also add, go to the jerk shack on the resort as much as possible! It was our favorite restaurant & probably the most authentic! We thought about going to Scotchie's, but we were so impressed by the jerk shack we didn't feel the need.