Having stayed at the Sea Temples in both Port Douglas and Palm Cove, I would recommend Port Douglas. While the Sea Temple in Palm Cove is a really nice hotel, the surrounding area is not so interesting, IMHO, whereas Port Douglas has a lot to do, and a lot of interesting restaurants. It is well worth the short additional drive.