To me it would depend on how loud and how brazenly the individual talked. If he was chatting in a low volume with his seatmate than that's his right. If he made it difficult for others around him to hear the safety announcement he should have gotten the boot.

Personally it was bad judgement on that guy's part to anger the flight attendant.. even if the punishment is a bit severe why annoy those folks on purpose??