Does the passes have your name on it? Do the terms prohibit you from giving the pass to someone else?
If the pass can be a gift, then I don't see how they can enforce the card-holder requirement. In any case, my guess is that you can use them even without the card.