Free Ticket?
How long ago did you buy it? If it's a bank error it will likely get caught eventually. They reconcile accounts every now and again. But if it's an error on kayak's end maybe they'll never notice... still will likely realize it eventually. Either way, written documentation that you've brought it to their attention and they said you don't owe might be a good idea, especially with the bank.