It is for outbound flights only...I guess this is your only argument here, i.e. "I'm here before my flight this evening". They may see just think you're rather taking the piss though!
Gold 'open doors' applies to any FLIGHT...it's not just an excuse to visit the lounge and get tanked for free (not that you're doing that) all day when you're not flying (as I believe one can at the landisde Qantas Pubs?

).
Spirit of the rules, the lounge lady is right. Letter of the rules, you're OK since you have an outbound BP later today. I think it's just they don't expect people to spend 6 hours in the Terraces?!
I suggest if you are challenged you explain politely and say you're just working and not nicking lots of booze and food, they should see it as reasonable.
Phil