Personally, I would never let jet lag stop me from visiting any place I wanted to go.
I'd take a trip to NZ any chance I had.
Jet lag does affect some more than others. When I travel through time zones, to get rid of jet lag I FORCE myself to do the following:
1. Immediately upon departure, I reset my watch to the destination time.
2. Drink lots of water on the plane. It's recommended that you avoid alcohol but I have been known to break this rule.

3. I force myself to assume the routine of the destination as soon as I arrive. For example, I may be dead tired when I get off the plane somewhere in Europe after an overnight flight from the US, but the worst thing I can do is head to the hotel and sleep. I force myself to grab breakfast, get a shower if I can, and stay awake during that first day. Most flights from the US to NZ will arrive early morning so the same situation applies.
Don't let jet lag stand in your way!!!!
cheers, geo