I had heard that Golds flying with AA could get refused access but I have been to that lounge on 4 occasions flying with AA and never been refused. To be honest you aren't missing much, the only hot food laid out is soup. The First section is dire.
Surley if you are Gold then the AA lounge would have given you a couple of drinks vouchers? They gave me 2 each for me and my wife.
Btw I don't thing the BA lounge opens till 3pm, well it didn't once when I passed by which is why we ended up in the Admirals club