Depending on what credit cards you have, you might want to hold on to them...
Chase is REALLY good about keeping track of sign-up bonuses so there is next to 0% chance of being able to churn a Chase cc.

If you don't want to pay the annual fee on the CSP, you can get it downgraded to just Chase Sapphire. Keep in mind that this will take away your ability to transfer points to partners.

If you have or intend to get the Chase Marriott/Priority Club cards, you could hold on to them, because the free night certificated would more than pay for the annual fee.