We always drive from Chamonix to the airport without going through Geneva, takes about an hour and a half at a moderate pace. Just use the E25 then follow the airport signs.

Geneva city centre can be a tangle of one-way streets and roadworks, avoid unless you plan to stop and walk around.