It's sometimes more convenient for the lounge agent to scan the card, so if you have it at the ready they'll usually appreciate it.

That said, if it's on your boarding pass, I've never had any problem with it (e.g. they direct me to Flagship Lounge in JFK even if I'm only flying J). They may have to type the number in manually or some such, from what I remember seeing.