from what I can tell, they keep threatening it, but never seem to follow through.

I just cancelled my card yesterday, but I just recently used all my miles, so my account's down to 81 miles. So I guess they can't take them back. But the guy on the phone didn't even mention anything.