That indeed is the fee, but they don't charge you extra over what you already paid, so in many cases the charged fee is a lot less than this. The way to look at it is they refund what you paid, minus that fee - but you don't pay extra to liberate the Avios. They split the booking (a few key strokes) and then cancel the return.