You CANNOT use the BA/QF lounge or any other lounges airside. As you WON'T be heading back to the departure level when getting the ferry. You will need a valid BP in order to get back to the departure level and re-clear security at the Transit Points.