FlyerTalk Forums - View Single Post - Air Canada experiencing nationwide network outage 12Mar18
Old Mar 13, 2018, 5:34 pm
  #123  
Fiordland
 
Join Date: May 2015
Location: Vancouver
Programs: Aeroplan, Mileage Plus, WestJet Gold, AMEX Plat
Posts: 2,026
Originally Posted by andrewBC
The likelihood of a data centre outage - in terms of power, cooling, or connectivity - is so absurdly low it doesn't register.
As it turns out about a year ago there was an outage at a data centre in Victoria that houses some of our system (not related to aviation in any way). The same data center also houses some provincial government ministry systems, federal government systems and some banking systems. BC Hydro was doing scheduled work on AC mains, the maintenance company that looks after the emergency generators left the generators in the wrong mode and they did not fire up as planned. This still happened with all the redundancy and diverse backup power systems. In a QA oriented environment people get trained to be systematic, so when you have human error it occurs systematically across all the generators.
Fiordland is offline