I have never encountered problems of changing Euro to USD at Deutsche Bank or Sparkasse, but I usually withdraw the money directly from my bank account at both banks. In everycase, I am usually visiting the larger branches.

The "Reisebank" (www.reisebank.de) has branches at Frankfurt main station and should be also able the exchange money from USD to EUR and vv.