I will disagree with most others , if in fact the baby was Always over the arm rest when not in the bassinet and coming into the OPs space, then I see it no different then a POS who spills overinto the other passengers space
However nothing is due if the woman simply didnt allow the OP to go in & out as frequent as they wanted to or for the bassinet being up on the wall