Outbound in the summer: Shorts, a button-down business casual shirt that I will press and wear again one day at the job site, dockers-style slip on shoes. Too hot in VPS on a Sunday afternoon to do otherwise.
Outbound in the winter: Business casual dress, which lets me avoid packing one pair of pants in my carryon, offset by the obligatory jacket for warmth when I get to my job site.
Inbound, summer or winter: The business casual I usually am wearing from the job site. It'll be at night when I arrive in Florida so the heat isn't so much of a concern in summer, and sometimes the jacket is nice to have handy in the winter.
I, too, never bring jeans. Too heavy. In summer, after hours, I can wear the shorts I came in on, and in winter, my business casual pants are fine. I always keep a pair of warm gloves permanently in the carryon, summer or winter, as I do not need them at home, and it saves me from trying to find them when winter comes.
In general: I, too, never pack blue jeans. While I love 'em, they are too, too, heavy to be putting in my carryon. In the summer, the shorts I wore outbound are fine to slip into after work; int he winter, the long pants I wore to work are fine. By picking the wardrobe(shirts match w/multiple pants and vice-versa), I can pack 2 weeks' worth of business dress into the carryon. Also, just 2 pr of shoes, usually, one of which I wear outbound, so just one pr has to go into the carryon.
Guess I'm lucky being a guy, as I am continually amazed at how much stuff my wife and daughter have to pack even for a 2-day weekend!