You should be able to get your bags tagged through to MEL.
When you get to SYD, follow the signs to transfers. Pick up your QF BP at the transfer desk and head through security to the gate/lounge. You will clear customs in MEL.
I have to ask though, why not take the UA continuation flight to MEL?