Going downtown is relatively easy. Between 10 and 20 minutes train ride to the main station. Now is it worth it? It depends on the timing. If it is not too early in the day, the Weihnachtsmarkt (Christmas Market) is worth a visit. Do also take into consideration passport issues (where you are coming from, where you are going, what it country of citizenship) as it will have an effect on the timing.