You should be fine. The infant in arms will get a boarding pass (this started about 2 years ago). We never had a problem with SDC. Once, the FA had to reshuffle people because we were on the side of the plane without the extra oxygen mask. It wasn’t a big deal and took 1-2 extra minutes.