It is a matter for your conscience.

Test it this way. If you told the agent at the Lounge that you had no intention of taking the BA flight, would s/he let you in to the Lounge? If you think the answer is "no", then arguably you are obtaining a benefit by a deception.