You probably were entitled to it, yes, however on the other hand there were presumably no visual indications on your boarding pass that you actually were. I can fully understand why the gate agent said you couldn't as s/he wouldn't have known about your previous sector.
I don't think there's an easy answer here, other than for BA to update its systems. Don't hold your breath.