The wording on the CO website is slightly ambiguous with regard to whether the BF service fee is refundable for "H" fares.
Generally, it is completely nonrefundable if you make any involntary changes and cannot re-confirm the upgrade, and my interpretation is that this holds true for H fares as well.