You should be fine.

Be prepared for some dirty looks from your fellow PAX when you get on board but there shouldn't be any issues.

The only thing to consider, since your baby will be on your lap, only the windows seats (I believe) have two oxygen masks. So best to avoid that before it is an issue.

Past that, enjoy the flight!