Are you OWE? If so, you wouldn't even need to be flying J or F to access the First Class Lounge. If you're not OWE, I wonder if the onward ticket boarding pass would be the one that determines which lounge you go to. If that is the case, then you may be shown the J lounge.