If the flight is more than 4-5 hours, or if it's a red-eye, then I wear warm-up pants and a long sleeve t-shirt. Otherwise, I wear a polo shirt and dress pants.

But, I always wear a pair of tennis shoes (it's hard to find size 13 4E wide shoes so I just wear the same pair for everything), and I always carry a jacket with me.