For what it's worth, I stayed at the Marriott Brisbane back in 2014 and the area around it seemed safe enough to me (albeit with a fair bit of construction). The room itself was fine too considering that I was really only there to sleep. Can't comment on the lounge.
Of course, it's very possible it's gotten worse since my stay, so maybe others with more recent experience can chime in.