I live in Australia, and if it's incredible scenery you're after, NZ wins by a country mile. The food and wine are also pretty much on par, and prices are a wee bit cheaper.

That said, if you've got three weeks, you can quite feasibly visit both! Just don't get too ambitious, Australia is big.