I have not faced any serious lines in my last two trips through Madrid passport control (Nov 2022 & Jan 2023) - however, a friend who traveled in Dec 2022 did have a 20+ minute wait in the non-EU line. Depending on what time you are departing and what passport you have, be prepared for the possibility of a delay.
Also, the lounge has been packed both of those recent trips (departing around Noon).
Bill