Why the quote marks? Does that mean that you intentionally kept the keys?

Either way, if Avis has a spare and they needed the vehicle, you are OK. If they didn't, you may find yourself hit with whatever the extra hour/day charges are until the vehicle is back in service.

I would get back there as early as possible, be apologetic and move on.