FlyerTalk Forums

FlyerTalk Forums (https://www.flyertalk.com/forum/index.php)
-   Delta Air Lines | SkyMiles (https://www.flyertalk.com/forum/delta-air-lines-skymiles-665/)
-   -   Delta computers down (https://www.flyertalk.com/forum/delta-air-lines-skymiles/1783354-delta-computers-down.html)

bretthexum Aug 8, 2016 7:08 am

NRT-LAX. Boarded ... And cancelled

jacobac00 Aug 8, 2016 7:10 am


Originally Posted by walterD (Post 27032000)
According to the flight captain of JFK-SLC this morning, a routine scheduled switch to the backup generator this morning at 2:30am caused a fire that destroyed both the backup and the primary. Firefighters took a while to extinguish the fire. Power is now back up and 400 out of the 500 servers rebooted, still waiting for the last 100 to have the whole system fully functional.

All I.T. execs should be given the boot if that is the case. If you have that kind of major event at your primary data center, you immediately fail over to your backup. Even a complex system like DL should have a 30 minute restore time for an event like this, and that is still slow. Amazing how some many big companies just "hope" things will always work.

Nimitz Aug 8, 2016 7:12 am


Originally Posted by Dieuwer (Post 27031922)
Considering Anderson's love of old but proven technology, the DL computer running on Cobol 1.0 must have run into a snag when one (or more) of the triode tubes burned out at the punchcard mainframe. :D

Funny, with a little truth to it I bet, but not to much I hope.

EditingFX Aug 8, 2016 7:12 am

nvr mind

KDCAflyer Aug 8, 2016 7:13 am


Originally Posted by jacobac00 (Post 27032008)
All I.T. execs should be given the boot if that is the case. If you have that kind of major event at your primary data center, you immediately fail over to your backup. Even a complex system like DL should have a 30 minute restore time for an event like this, and that is still slow. Amazing how some many big companies just "hope" things will always work.

DL is making billions, but can't bother to spend money upgrading that one thing that can ground the entire airline upon failure.

MSPeconomist Aug 8, 2016 7:14 am


Originally Posted by DiverDave (Post 27031978)
You nailed it. ^ ^

Though I would think about most flights would be zeroed out while everything gets sorted.

Fortunately, I am not flying today, but I am sure the cleanup will continue into tomorrow when I am flying.

David

Surprisingly, inventory isn't zeroed out on the flights I'm watching for today and tomorrow.

EditingFX Aug 8, 2016 7:15 am


Originally Posted by jacobac00 (Post 27032008)
If you have that kind of major event at your primary data center, you immediately fail over to your backup.

Backup?

Ah... backup! Brilliant! ;)

AAExPlat Aug 8, 2016 7:15 am


Originally Posted by jacobac00 (Post 27032008)
All I.T. execs should be given the boot if that is the case. If you have that kind of major event at your primary data center, you immediately fail over to your backup. Even a complex system like DL should have a 30 minute restore time for an event like this, and that is still slow. Amazing how some many big companies just "hope" things will always work.

Totally agreed. And failing over to secondary has never been easier than today, given cloud options AND local secondary options. I just don't get what their game plan ever was...

MSPeconomist Aug 8, 2016 7:16 am


Originally Posted by bretthexum (Post 27032003)
NRT-LAX. Boarded ... And cancelled

Did the crew time out? If other flights are leaving NRT, that's a bit surprising as LAX is fewer flight hours than some of the other TPAC routes.

Is there space and time to rebook people for flights leaving today?

scongro Aug 8, 2016 7:17 am


Originally Posted by walterD (Post 27032000)
According to the flight captain of JFK-SLC this morning, a routine scheduled switch to the backup generator this morning at 2:30am caused a fire that destroyed both the backup and the primary. Firefighters took a while to extinguish the fire. Power is now back up and 400 out of the 500 servers rebooted, still waiting for the last 100 to have the whole system fully functional.

If that's true, then while this is preventable that's certainly a crazy one. This isn't usually at the top of anyone's DR plan, but part of system redundancy is physical separation between primary and backup systems. This isn't cheap to do (right) so many companies don't go to this level, but surprising Delta didn't.

On many DR plans, there are known weak spots where a company knows it has a deficiency and makes a conscious decision to not invest in resolving. For the average company, this would likely fall into this area, but for a company the size of Delta it's surprising.

Obviously this is entirely speculation but more importantly, if there was a fire I hope no one was injured.

KDCAflyer Aug 8, 2016 7:17 am


Originally Posted by AAExPlat (Post 27032034)
Totally agreed. And failing over to secondary has never been easier than today, given cloud options AND local secondary options. I just don't get what their game plan ever was...

Well, I guess we know now.

Start_at_UIN Aug 8, 2016 7:17 am


Originally Posted by DiverDave (Post 27031978)
Fortunately, I am not flying today, but I am sure the cleanup will continue into tomorrow when I am flying.

Same here. I was going to try and SDC to later flights, but now might just stick with the original.

MrAndy1369 Aug 8, 2016 7:18 am


Originally Posted by MSPeconomist (Post 27031780)
but you pay the fare difference

Huh? So DL expects pax to pay the fare difference for their mistake? :confused:

qukslvr619 Aug 8, 2016 7:20 am

Future Reservations Impacted
 
Just went to view my reservation for next week and all of my upgrade requests are gone. Don't even see the option to select Y+ and/or F.

KDCAflyer Aug 8, 2016 7:20 am


Originally Posted by MrAndy1369 (Post 27032053)
Huh? So DL expects pax to pay the fare difference for their mistake? :confused:

Yeah I highly doubt that. Just the standard language that DL puts up during IRROPs.


All times are GMT -6. The time now is 5:37 pm.


This site is owned, operated, and maintained by MH Sub I, LLC dba Internet Brands. Copyright © 2026 MH Sub I, LLC dba Internet Brands. All rights reserved. Designated trademarks are the property of their respective owners.