Downgrading would happen if there is no seat availability in J at the time the re-accommodation tool runs. Now when you came to accept if that was some time later J availability may have reappeared so it would certainly be worth checking just before you accept.
It is a bit disappointing that the BA agent in your case didn't agree to move you back the first time bearing in mind the circumstances.