To me, I would probably just stay in ZRH since that was where my long haul flight was from.
I am in GVA every six weeks and the FS is a terrific property, with a nice outside dining area during the summer. There are some excellent suites, the rooms I have seen and stayed in are large, nice bathrooms, excellent service and some of the most amazing flower arrangements in the lobby.
I haven't been to the Dolder yet since the renovation, but my friends in ZRH give it mixed reviews. It's mixing of modern and classic design is a bit controversial.
That said, it is not directly in the city, but located outside so it gives you a resort feel.
I would say the option since you feel ambivalent about where you start your trip is do you want a city hotel experience (FS) or a European mountain resort experience (Dolder)?