Either way, AMEX has a record of you using your card to get in. If you haven't paid your annual fee, that would be an interesting scenario.
When they swipe mine, they don't really wait for it to be approved for me to go on in, but I'm sure they'd come find me if it was denied.