Accuracy of commercial antibody kits for SARS-CoV-2 varies widely

There is wide variation in the performance of commercial kits for detecting antibodies against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), according to a study published September 24 in the open-access journal PLOS Pathogens by Jonathan Edgeworth and Blair Merrick of Guy’s and St Thomas’ NHS Foundation Trust, Suzanne Pickering and Katie Doores of King’s College London, and colleagues. As noted by the authors, the rigorous comparison of antibody testing platforms will inform the deployment of point-of-care technologies in healthcare settings and their use in monitoring SARS-CoV-2 infections.

Throat and nose swab tests for SARS-CoV-2 establish if someone is infected with the virus that causes coronavirus disease 2019 (COVID-19). These tests are highly sensitive – capable of detecting very low viral RNA levels – and are optimal for the early detection of the virus. The performance of these tests depends on the time the sample is collected, with viral load declining after the first week of symptoms. By contrast, antibody tests can determine whether someone has had the virus in the past. For diagnosis later in disease, or in delayed-onset syndromes, antibody tests could form an important part of hospital diagnostic capabilities. In the new study, the researchers developed their own sensitive and specific antibody assay and used it to conduct unbiased, head-to-head comparisons of ten commercial antibody test kits on an identical panel of 110 SARS-CoV-2-positive blood samples from patients admitted to hospitals with COVID-19 and 50 pre-pandemic negatives. 

There was a broad range of performance among the tests, with specificity — the ability of the test to correctly identify those without the disease (true negative rate) — ranging from 82% to 100%, and overall sensitivity — the ability of a test to correctly identify those with the disease (true positive rate) – ranging from 60.9% to 87.3%. But all gave the best results when used 20 days or more after the start of symptoms, with most tests reaching a sensitivity value greater than 95%. In addition, antibody levels were higher in individuals with severe illness compared to those with asymptomatic or mild disease. When all commercial tests were compared, lateral flow immunoassays called Accu-Tell, SureScreen and Spring demonstrated highest sensitivity at earlier time points, while maintaining specificities of 98% or above. Such lateral flow immunoassays are affordable, quick and easy to use, and if they are deployed appropriately, could have considerable usefulness in healthcare settings. 

Co-author Jonathan Edgeworth notes, “We found that some of the quick single-use kits (LFIAs) are as accurate as our sophisticated laboratory technologies. Encouraged by these findings we are piloting LFIAs in the hospital to give doctors a quick reliable answer in a range of clinical settings.”

 

##### 

 

Research Article

 

Funding: The research and the King’s College London Infectious Diseases Biobank were supported by the Department of Health via a National Institute for Health Research comprehensive Biomedical Research Centre award to Guy’s and St. Thomas’ NHS Foundation Trust in partnership with King’s College London and King’s College Hospital NHS Foundation Trust. AWS and CG were supported by the MRC-KCL Doctoral Training Partnership in Biomedical Sciences (MR/N013700/1). GB was supported by the Wellcome Trust (106223/Z/14/Z to MHM). SA was supported by an MRC-KCL Doctoral Training Partnership in Biomedical Sciences industrial Collaborative Award in Science & Engineering (iCASE) in partnership with Orchard Therapeutics (MR/R015643/1). NK was supported by the Medical Research Council (MR/S023747/1 to MHM). SP, HDW and SJDN were supported by a Wellcome Trust Senior Fellowship (WT098049AIA). King’s Together Rapid COVID-19 Call awards to MHM, KJD, SJDN and RMN. Fondation Dormeur, Vaduz for funding equipment (KJD). MRC Discovery Award MC/PC/15068 to SJDN, KJD and MHM. Development of SARS-CoV-2 reagents (RBD) was partially supported by the NIAID Centers of Excellence for Influenza Research and Surveillance (CEIRS) contract HHSN272201400008C. The work was supported by gifts from Peking University donors and Anhui Deep Blue company. We also thank the following sources for donation of test kits: the manufacturers of Spring, Biohit, Genbody, Medomics and Watmind. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

 

Competing Interests: The authors have declared that no competing interests exist.

 

Citation: Pickering S, Betancor G, Galão RP, Merrick B, Signell AW, Wilson HD, et al. (2020) Comparative assessment of multiple COVID-19 serological technologies supports continued evaluation of point-of-care lateral flow assays in hospital and community healthcare settings. PLoS Pathog 16(9): e1008817. https://doi.org/10.1371/journal.ppat.1008817

 

Author Affiliations:

Department of Infectious Diseases, School of Immunology & Microbial Sciences, King’s College London, London, United Kingdom.

Centre for Clinical Infection and Diagnostics Research, Department of Infectious Diseases, Guy’s and St Thomas’ NHS Foundation Trust, London, United Kingdom.

Centre for Inflammation Biology and Cancer Immunology (CIBCI), Dept of Inflammation Biology, School of Immunology & Microbial Sciences, King’s College London, London, United Kingdom.

MRC Laboratory of Molecular Biology, Cambridge, United Kingdom.

Division of Infection and Immunity, University College London (UCL), London, United Kingdom.

Department of Medical Microbiology, Amsterdam UMC, University of Amsterdam, Amsterdam Infection & Immunity Institute, Amsterdam, the Netherlands.

 

Press-Only Preview of the Article: http://plos.io/ppat-1008817

 

In your coverage please use this URL to provide access to the freely available paper: http://journals.plos.org/plospathogens/article?id=10.1371/journal.ppat.1008817

 

 

About PLOS Pathogens

PLOS Pathogens is the first Open Access journal for breakthroughs in understanding pathogens and their interactions with host organisms. The journal publishes original research and commentary that yield novel insights into pathogenesis that are of broad interest and importance to researchers studying pathogens and pathogen-host interactions.  For more information, visit http://journals.plos.org/plospathogens, and follow @PLOSPathogens on Twitter.

 

Media and Copyright Information

For information about PLOS Pathogens relevant to journalists, bloggers and press officers, including details of our press release process and embargo policy, visit http://journals.plos.org/plospathogens/s/press-and-media.

 

PLOS journals publish under a Creative Commons Attribution License, which permits free reuse of all materials published with the article, so long as the work is cited. 

 

About the Public Library of Science
Public Library of Science (PLOS) is a nonprofit Open Access (OA) publisher, innovator and advocacy organization dedicated to accelerating progress in science and medicine by leading a transformation in research communication. The PLOS suite of journals contain rigorously peer-reviewed Open Access research articles from all areas of science and medicine, together with expert commentary and analysis. In addition to journals, the organization advances innovations in scientific publishing through Collections, Communities and The PLOS Blog Network. Founded to catalyze a revolution in scientific publishing by demonstrating the value and feasibility of Open Access publication, PLOS is committed to innovative and forward-looking solutions to scientific communication. For more information, visit https://www.plos.org/who-we-are.