I suspect the cabin crew thought that it was easier for them to facilitate the seat swap than to have the CK DYKWIA guy complain and try to get the FAs to help him get seats together for the family or demand that the cabin crew upgrade the wife and daughter during the flight, find better seats for wife and daughter even if they couldn't sit next to the CK, etc.