The Hidden Dangers of Excel: A Critical Look at Its Use in High-Stakes Systems

Strategic Insights -

The critical use of Excel in high-stakes systems has been brought to the forefront by the recent temporary loss of 16,000 coronavirus case records by Public Health England (PHE), which analysts believe may have caused suffering and even death. This incident highlights a worrying trend of relying on outdated versions of Microsoft's ubiquitous spreadsheet software in critical national systems, despite warnings from experts about the dangers of spreadsheet errors. The use of Excel in such situations raises questions about the competence and judgment of those responsible for designing and implementing these systems, as well as the need for more robust and reliable data management solutions.

Key Takeaways:

  • Public Health England (PHE) used an outdated version of Microsoft Excel ( xls file format, est. 1987) in a critical track and trace system, leading to the loss of 16,000 coronavirus case records.
  • The use of Excel in high-stakes systems is a ticking time bomb, with experts warning that spreadsheet errors can cause catastrophic consequences.
  • The "European Spreadsheet Risks Group" (EuSprig) has compiled a list of horror stories at banks, airlines, police forces, and the London 2012 Olympics committee where duff spreadsheets caused total financial discrepancies of almost £8.7 billion.
  • A 2010 research paper by economists Carmen Reinhart and Kenneth Rogoff omitted five countries out of 20 from their Excel spreadsheet, leading to an incorrect conclusion that too much national debt leads economies to stutter.
  • Genes such as septin 2 and membrane-associated ring-CH-type finger 1 were automatically converted into dates by the helpful software, leading to errors in studies of genetics.
  • Experts agree that Excel is not the problem, but rather the fault lies with those who decided to use it in critical systems, highlighting the need for proper training and more robust data management solutions.
  • PHE has temporarily solved the problem by splitting up its big, broken Excel spreadsheets into batches of smaller Excel spreadsheets.

Statistics:

  • 16,000 coronavirus case records lost due to Excel error (Source: Article)
  • £6 billion lost by JP Morgan Chase due to the "London Whale" incident (Source: Article)
  • £8.7 billion total financial discrepancies caused by duff spreadsheets (Source: EuSprig website)
  • 2010 research paper by economists Carmen Reinhart and Kenneth Rogoff omits five countries out of 20, leading to incorrect conclusion (Source: Article)
  • 65,536 rows available in the older .xls file format (est. 1987) (Source: Article)
  • 1 million rows available in the most recent .xlsx file format (since 2007) (Source: Article)

Sources:

  • Article: "The Hidden Dangers of Excel: A Critical Look at Its Use in High-Stakes Systems"
  • EuSprig website: "Horror stories" at banks, airlines, police forces, and the London 2012 Olympics committee
  • Carmen Reinhart and Kenneth Rogoff research paper (2010): "This Time is Different: Eight Centuries of Financial Folly"
  • Sarah Wollaston, former Conservative and then Liberal Democrat MP, interview with The Telegraph
  • Christina Warren, developer liaison at Microsoft, interview with The Telegraph
  • Simon Thorne, senior lecturer in information systems at Cardiff Metropolitan University, interview with The Telegraph
  • Adam Jacobs, medical statistician and director of biostatistics at Premier Research, interview with The Telegraph
  • European Spreadsheet Risks Group (EuSprig), founded by Professor Brian Booth, Bristol University.