you should be ok with out it, make sure you have your BAEC number in the booking.
Also AA treat you well as BA silver. They give you economy plus, drinks vouchers etc. Also will let waitlist for earlier flights etc.
Edit. only time i have ever shown the actual card is at the Air lingus lounge at LHR