Finally got through to Ryanair. The rep told me that it does not matter what passport number you use to BOOK your flight as the details are not saved. You are asked to enter your passport details again when you do online check in and this is where it counts.

Since we had not checked in yet, we are fine.