Both had just as much claim to the empty seat as neither had purchased it.
The parent should have moved quicker, it was pretty much a matter of who got there first.
Though I do think the guy was being a jerk about it, I would never taken up an empty seat with somebody with a lap child next to me.
The parent should have started practicing what ever repetitive super annoying song the kid has learned in the last few days.