As already mentioned Costa Rica and Belize are good choices, as are Chile and Turkey! They would each pretty much satisfy all your requirements. Since you plan on 3-4 weeks and you like to explore, Bermuda (as someone else suggested) would most probably be too limiting.