From crisis to routine – Standardization of SARS-CoV-2 genome detection by enhanced EQA schemes in a scientific pandemic network

Abstract

In the beginning of 2020, the outbreak of the COVID-19 pandemic led to a crisis in which diagnostic methods for the genome detection of SARS-CoV-2 were urgently needed. Based on the very early publication of the basic principles for a diagnostic test for the genome detection of SARS-CoV-2, the first noncommercial laboratory-developed tests (LDTs) and commercial tests were introduced. As there was considerable uncertainty about the reliability and performance of different tests and different laboratories, INSTAND established external quality assessment (EQA) schemes for the detection of SARS-CoV-2 starting in April 2020. In close partnership in a scientific network, the EQA schemes were enhanced, especially the April, June and November 2020 terms. The enhancement included: (i) immediate provision of suitable virus including variants of concern at the beginning of the pandemic outbreak, (ii) short frequency of EQA schemes, (iii) concentration dependency of the testing and sensitivity check, achieved by using SARS-CoV-2-positive samples from a 10-fold dilution series of the same starting material, (iv) specificity check of the testing, achieved by using SARS-CoV-2-negative samples containing human coronaviruses or MERS CoV, (v) revealed samples for orientation on test performance during an ongoing or at the start of an EQA scheme using a pre-quantified SARS-CoV-2-positive EQA sample with a low viral RNA load of only 1 570 copies/mL assigned by digital PCR (dPCR) in June 2020 and (vi) quantified reference materials based on the experiences of the first two EQA schemes with dPCR-assigned values in copies/mL beginning in November 2020 for self-evaluation of the applied test system. This manuscript summarizes the results of a total of 13 EQA schemes for the detection of SARS-CoV-2 between April 2020 and June 2023 in which a total of 1 413 laboratories from 49 countries participated. The qualitative results for the detection of SARS-CoV-2-positive samples were between 95.8 % and 99.7 % correct positive, excluding extremely low concentration samples. For all SARS-CoV-2-negative EQA samples, the qualitative success rates ranged from 95.1 % to 99.4 % correct negative results. The widely varying values for the cycle threshold (Ct)/crossing point (Cq) reported for the different target genes and test systems were striking. A few laboratories reported quantitative results in copies/mL for several VOCs with an acceptable rate of over 93 % correct positive results in the majority of cases. The description of the enhanced EQA schemes for SARS-CoV-2 detection in terms of timing and scope can serve as a blueprint for the rapid development of a quality assessment of diagnostics for an emerging pathogen.