You can cancel anytime before the flight takes off to have your points returned. What you might want to do is to book a fully-refundable ticket on another airline (or another points booking that allows for redeposit) as a backup if you are that concerned.