I'm probably the biggest cheerleader for the Bora Bora Nui on this board, but sadly I had a similar experience on the first of two stays there - albeit less costly.

A minor item of clothing was stolen.

So yes, you need to be careful because there is the odd bad apple.