You also have to go from Terminal 4 to Terminal 2 at JFK, and your Continental plane is a slower prop.
Any chance you can switch to a Delta Connection flight? That way, you're protected, on a jet (that CO flight is a dash 8), and at least you're in the same terminal building at Kennedy.
-A