There can only be one link to/from a card. If your card is linked to any other account, the transfer will fail. Additionally, you cannot link a card within 24 hours of it having been unlinked from a different account. So make sure your card is not currently linked anywhere, and then make sure you've waited 24 hours before attempting another transfer.