Q is upgradable with miles. However, as at least one of your Q flights is not on Air France metal, I doubt you would ever be able to upgrade this flight.

Your AF Q flight can be upgraded, but only if there is an available seat for upgrades, which may be unlikely. You should enquire about this sooner rather than later.

"Day of departure" upgrades usually means paying cash.