Be sure that you're doing advanced search by fare class on delta.com and experiment with the whatever BE fare of higher drop down menu. Sometimes delta.dumb wants to break the fare and charge you more than the cost of using the higher fare class for the entire trip.

The difference in change fees sounds like you have a deep discount fare code in one or more segments.