I would skip Brisbane. Is there any particular reason why you want to go there?

I used to live there and loved it - but it's not really the most exciting destination.

Definitely get the extra day in Cairns (or longer if you skip Brisbane). Are you planning to go to the reef there?