They're inconsistent for sure. I often fly J and use the lounge just by showing my boarding pass. Occasionally I fly Y on very short legs or on regional jets that only have a Y cabin, and I hand them my platinum Aeroplan Amex to get lounge access.
Sometimes they only want to see the card. Other times they ask for the boarding pass with the card. There seems to be no rhyme or reason.