I had an experience when I entered the BA lounge using my CX membership because I hadn't reached silver with BA at that stage. The lounge attendant at the door changed the FF number to CX from BA. She didn't really tell me this but I suspected it happened.
So I went to the guest services desk inside the lounge to check and he changed it back to BA for me. So it definitely can be done in the lounge.