Tuesday, 26 November 2024

    Why using Microsoft Excel tool caused Covid-19 results to be lost

    The badly thought-out use of Microsoft's Excel software was the reason nearly 16,000 coronavirus cases went unreported in England.

    And it appears that Public Health England (PHE) was to blame, rather than a third-party contractor.

    The issue was caused by the way the agency brought together logs produced by commercial firms paid to analyse swab tests of the public, to discover who has the virus.

    They filed their results in the form of text-based lists - known as CSV files - without issue.

    PHE had set up an automatic process to pull this data together into Excel templates so that it could then be uploaded to a central system and made available to the NHS Test and Trace team, as well as other government computer dashboards.

    The problem is that PHE's own developers picked an old file format to do this - known as XLS.

    As a consequence, each template could handle only about 65,000 rows of data rather than the one million-plus rows that Excel is actually capable of.

    And since each test result created several rows of data, in practice it meant that each template was limited to about 1,400 cases.

    When that total was reached, further cases were simply left off.

    For a bit of context, Excel's XLS file format dates back to 1987. It was superseded by XLSX in 2007. Had this been used, it would have handled 16 times the number of cases.

    At the very least, that would have prevented the error from happening until testing levels were significantly higher than they are today,

    But one expert suggested that even a high-school computing student would know that better alternatives exist.

    "Excel was always meant for people mucking around with a bunch of data for their small company to see what it looked like," commented Prof Jon Crowcroft from the University of Cambridge.

    "And then when you need to do something more serious, you build something bespoke that works - there's dozens of other things you could do.

    "But you wouldn't use XLS. Nobody would start with that."

    Speaking in the House of Commons, the Health Secretary Matt Hancock suggested that the problem had emerged as a result of PHE using a "legacy system" and a decision had been taken two months ago to replace it.

    source:BBC

    © 2024 SALT MEDIA. All Rights Reserved.