I just threw away 4 cards that had been replaced due to fraudulent usage and use at Target (no fraud).

I also had 2 others replaced due to fraudulent use, and the replacements came with a return envelope, which I used.

The way I see it, the account is closed, I don't care if someone knows my old number.