Two thoughts:

First, BA gets paid every time you credit a flight on another carrier to them. The other airline pays the price of the Avios.

Second, if you don't fly BA much (only four flights) then the cost to BA of giving you access to the CCR, jokers, etc is pretty low, especially given you'll need lots of Avios (ie cash to BA) to use things like jokers and upgrades.