I was a little nervous pre-Rio too, but I really really loved my time there. I felt fine at the beaches, walking around town during the day and on the busier streets at night, and I was alone (granted people think I look Brasilian, and being 6'4 215lb probably helps too).

Plus, if you don't go out at night you'll miss the amazing samba music in Lapa!!!