If it was booked on AA.com then you need to call AA to change.
Ah ok, even if I have the BA booking ref for the BA leg?
I will call AA though as you say, because they should be the ones to tell me the booking fare rules as it is their ticket I guess.