I'm not sure if that used to be easier in the past, but the agent I dealt with refused to waive the fee. I called back a few hours later and they said they'd process a refund of the fee as a courtesy. Called back today to see if that was processed because I didn't receive the confirmation the other agent mentioned I would. The agent I spoke to today was just plain rude. He told me derisively that he "wouldn't have done it" because "if you could book on the internet they wouldn't need us here." Still waiting on the transactions to post to my Amex to see if the refund was actually processed.

Better luck to the OP!