I've visited there a couple times when a friend was managing the place. I'd stay in Port Douglas. More going on and easier to catch boats to the reef from there. Turtle Cove is isolated, but if that's what you're looking for it might be perfect.