I've found that most people are in a big hurry to get out, and loop/river north bars aren't too packed. Have a drink or two and wait for the crowds to die down.
By waiting for hours of crowds, I mean the people that camp out for a decent view of fireworks. Given that the Fairmont is so close to the action you can stay as long or short as you feel the evening of. Sometimes the crowd feeling is very positive, sometimes I am ready to go home. Enjoy, also make sure to check out the wine bar at the Fairmont.