Showing posts with label Southwest Airlines. Show all posts
Showing posts with label Southwest Airlines. Show all posts

09 August 2016

Single Router Failure Blamed on Southwest Outage

Screenshot of Computerworld story on Southwest Airlines Outage in July 2016
Computerworld Story on July 2016 Outage at Southwest Airlkines

Single point of failure.  You know the concept.  Those single points are easier to see in the rear view mirror. Can a single router cause an entire data center to go down?

In a Dallas Morning News story, CEO Gary Kelly said it could -- and did. There was a "backup system" in place to address a single router failure. 

But, Kelly insisted, because of the router's unusual "partial failure," the backup procedures weren't triggered, and the problem became a massive one.

No, this isn't a very good technical explanation .

Kelly took pains to insist that the legacy technology in their data center wasn't involved in the failure. Nor was the cause a hack of some sort (probably true, though at the time of this report it might be premature to completely rule that out).

Whether they're justified in saying so or not, Southwest Airlines unions want a change of leadership, arguing that the CEO and others are delaying technology improvements in order to maintain profits for investors. (True, Southwest employees hold plenty of Southwest stock, too.) What do the IT folks at Southwest say? I didn't see any comment on that.

CNBC listed the publicly reported airline technology failures since 2015.



Single Router Failure Blamed on Southwest Outage

Screenshot of Computerworld story on Southwest Airlines Outage in July 2016
Computerworld Story on July 2016 Outage at Southwest Airlkines

Single point of failure.  You know the concept.  Those single points are easier to see in the rear view mirror. Can a single router cause an entire data center to go down?

In a Dallas Morning News story, CEO Gary Kelly said it could -- and did. There was a "backup system" in place to address a single router failure. 

But, Kelly insisted, because of the router's unusual "partial failure," the backup procedures weren't triggered, and the problem became a massive one.

No, this isn't a very good technical explanation .

Kelly took pains to insist that the legacy technology in their data center wasn't involved in the failure. Nor was the cause a hack of some sort (probably true, though at the time of this report it might be premature to completely rule that out).

Whether they're justified in saying so or not, Southwest Airlines unions want a change of leadership, arguing that the CEO and others are delaying technology improvements in order to maintain profits for investors. (True, Southwest employees hold plenty of Southwest stock, too.) What do the IT folks at Southwest say? I didn't see any comment on that.

CNBC listed the publicly reported airline technology failures since 2015.



12 October 2015

'Computer glitch' blamed for Southwest Airlines flight delays | Maryland News - WBAL Home

WBAL TV Report on Southwest Airlines Outage

Are airline reservation systems especially exposed to public failure, or is there an underlying pattern of instability, perhaps industry-wide, that reflects design problems with resilience and reliability? Are after action reviews conducted shared across similar system operators? The evidence would seem to indicate that they do not.

Read this WBAL TV report about the glitch, which "affected the air carrier's website, mobile app, phone centers and airport check-in systems."  The problem began yesterday, with system-wide impact, and continued until, reportedly, around 8A Monday morning, when a "fix" was announced. 


22 June 2013

Southwest Airlines System-wide Software Outage

Southwest Airlines home page screenshot
Southwest Airlines grounded 250 flights.
Late in the evening of 21 June 2013, a software failure of unreported origin caused a system-wide outage at Southwest Airlines. The outage lasted for three hours, according to news reports,  until 2A Eastern. During this period, 250 flights were grounded. As reported by USA Today, "the glitch impaired the airline's ability to do such things as conduct check-ins, print boarding passes and monitor the weight of each aircraft." A backup system was deployed, according to this source, around 8 pm Pacific time, but it was running much more slowly.