Yes always travel as casual as possible. Normally in Y but get lounge access through being *G. Never had a problem entering a lounge no matter what I'm wearing (but I am never that scruffy).

Occassionally have to go straight from the flight to a meeting and then will at least wear smart trousers and a shirt. If a tie is needed it is put on in the taxi on the way to the meeting.