Bistro du Coin is probably the best French option immediately in Dupont, at Connecticut and R.

Outside of Dupont, I can recommend Bistro Lepic for French in upper Georgetown, on Wisconsin Ave. Very small place, but nice atmosphere and good food.