I would highly recommend driving, but if you're insistent that you don't want to drive, I would still start out in Queenstown for 3-4 days so that you can take a guided tour of Milford Sound and explore areas around town. From there, not having a car really limits your ability to see and do quite a lot of things and it makes travel very inefficient.