I've stayed at both the Vermont and Dupont Circle on business and last spring (during the cold snap) with family at Dupont Circle.
I prefer Dupont Circle...quick walk to Metro and quick stroll to many resturants and the Phillips Collection, an unexpected museum treat.
Dupont Circle would be my first choice with family, but Vermont would be great as well!