As the recipient of 225,000 "bonus" Skymiles earlier this year, I've thought a bit about this.
Bottom line is KARMA. Pay now or pay later.
The miles are NOT yours. You should give them back.
My miles are now gone but I feel very good about my decision.