I think this is what you were looking for - just off Paraderplatz on the Bahnhofstrasse... extracted review courtesy of Zagat!

Zeughauskeller

Bahnhofstr. 28a Zurich 41-1 -211-2690

“Fun” “for visitors”, this “pleasant and informal” “beer hall” “in a medieval building” (a “15th-century armory”) “in the midst of the Old Town” (District 1) is “always crowded” with “many locals” and “big parties” of “American tourists”, all of whom “share tables” and feast on “simple” fare that “couldn’t be more typically Swiss”; a true trencherman’s treat, it offers “large portions” of “a wide variety of sausages”, including the “one-meter-long Kanonenputzer (cannon cleaner) – a must.”