I never had any problems there at all. Perhaps would just add the standard advice about watching out for pickpockets at the train station, but that's it.

Gori is just to see Stalin's birthplace? Mtskheta is also not a long drive away and has the spectacularly beautiful Jvari monastery. It is absolutely worth a look.