Did you cancel before midnight of the day following the purchase?

Seat upgrade fees (as opposed to the cost to upfare to a higher cabin class) generally aren't refundable when you voluntarily change flights.