Yep, I've flown back from SYD in Y and gone straight into the office. So long as you can ensure you don't have a "difficult" day when you arrive back then you should be fine.
However, and this may be controversial, I find it increasingly more difficult as I get older to do this! A friend of mine, who is 15 years older, used to complain about jetlag when I had no problems. However now, maybe 10 years later, it is getting a bit more difficult for me too......
Andrew