This has happened to me in the current era of "we'll charge card on file via the app" with UA. Rather than fight the battle that you're fighting, I deleted the card number that UA's systems kept on using.

The systems then went to use the card I wanted used. Since then (I forget the amount of time (month+)), I've re-added the less relevant Chase UA card.

David