I personally think you would be crazy to go for it saimike.Even if your plane from the south is on time three hours would be tight enough - dooable but not very relaxing way to start a long flight home. You would be very unlikely to make it even with a short delay I would imagine.
Save El Calafate for another day and go somewhere else, Montevideo is a short hop and very nice along with Colonia.