The InterContinental is my go-to hotel when I'm in BA, having stayed there multiple times. The area is a bit dodgy, but mostly because it appears to be a business district and there's no life on the street after business hours or on the weekend. It doesn't seem inherently like an unsafe neighborhood.

At that time of night, I wouldn't be walking down the street - I'd take a cab.