Not much sense of adventure here!
Think I'd get a hotel near the airport (Amara on Le Van Si is not far away)... Then get a taxi into the centre - be prepared for good-natured grid lock. See the Vietnamese do their thing around Nguyen Hue/Le Loi. Will be great fun!
Don't take any valuables... just enough cash to get yourself back. Return some time after midnight.