I never really had the urge to visit Oz either. However after our trip to New Zealand (which was fantastic) we just spent a couple of days in Sydney. I was most impressed and would love to go back and see more.
Definitely try and visit both countries...you won't be disappointed. The QF SYD lounge is not a bad little cafe either.