Yes, purchasing new fares and then cancelling them will achieve your goal.

However, be careful to note which of your credits will expire and which will not. If past precedent applies, you could wind up turning non-expiring credits into expiring one. They did away with credits expiring but only for flights purchased after July 28, 2022.
​