Have you tried contacting the hotel to see if they will let you change?

Sure, you could cancel the card, but that seems like a huge step just to avoid a charge that you agreed to pay.