I'm not bothered on a short haul, especially on BA because there is no middle seat passenger in CE.
However, I prefer my husband to be next to me on a longer flight if the seats are in pairs. That's only because if he's sitting there, no-one else can, not because I feel the need for him to be sitting close to me. I would avoid having a stranger sit next to me if I can.
Again on BA long haul I am not too bothered - CW divider up, goodbye neighbour!