This is no different than checking out of your hotel and then finding a charge to your CC for the minibar that you never even opened. It happens, but luckily infrequently.
If this happened more than 25% of the time, then I'd say that's a problem (IMHO, YMMV).