How much time will take immigration/security - really depends on time of the day and week. If you decide to go to the city (assuming that you have visa or do not need visa), instead of using public bus rather take Grab.
I would recommend to avoid Ben Thanh or if you plan to go, make sure that keep all valuables (handbags, phones, camera, etc) close to body and not lower your shields and defenses.