I've never had a problem walking down 5th St to and from Market at night. I used to play Tuesday night bar trivia at 5th & Howard and had to walk back to Market Street to get to the underground.

I would avoid the same stretch of 6th Street, however, at all costs.