You could downgrade to Gold or Green without affecting the age of the account. When you do close it, the account will remain on your credit history for a decade, by which time you will likely have other accounts that are sufficiently aged.
I have each of those as well, but I get your point. I guess then for sentimental reasons, I can't see giving it up.