The only points you would "lose" when you cancel the card is the Chase Sapphire, but that is a free card ... do you have the Sapphire Preferred?
The Chase PC Card costs $49, but you get a free night that can be used at any property, making the fee very worth it.