some of You wI’ll be surprised with EU laws regarding family.
I doubt there will be any surprises for us.
You will tell us that dependends of EU citizen can travel freely to the UK. No one here will doubt that.
However, you need proper documentation (a visa/EEA Family Permit) in order to exercise these EU rights. Your baby lacked this proper documentation.