key: cord-281495-beb164oy
authors: Charpentier, Charlotte; Ichou, Houria; Damond, Florence; Bouvet, Elisabeth; Chaix, Marie-Laure; Ferré, Valentine; Delaugerre, Constance; Mahjoub, Nadia; Larrouy, Lucile; Le Hingrat, Quentin; Visseaux, Benoit; Mackiewicz, Vincent; Descamps, Diane; Fidouh-Houhou, Nadhira
title: Performance evaluation of two SARS-CoV-2 IgG/IgM rapid tests (Covid-Presto and NG-Test) and one IgG automated immunoassay (Abbott)
date: 2020-09-03
journal: J Clin Virol
DOI: 10.1016/j.jcv.2020.104618
sha: 
doc_id: 281495
cord_uid: beb164oy

The aim of this study was to assess the analytical performances, sensitivity and specificity, of two rapid tests (Covid- Presto® test rapid Covid-19 IgG/IgM and NG-Test® IgM-IgG COVID-19) and one automated immunoassay (Abbott SARS-CoV-2 IgG) for detecting anti- SARS-CoV-2 antibodies. This study was performed with: (i) a positive panel constituted of 88 SARS-CoV-2 specimens collected from patients with a positive SARS-CoV-2 RT-PCR, and (ii) a negative panel of 120 serum samples, all collected before November 2019, including 64 samples with a cross-reactivity panel. Sensitivity of Covid-Presto® test for IgM and IgG was 78.4% and 92.0%, respectively. Sensitivity of NG-Test® for IgM and IgG was 96.6% and 94.9%, respectively. Sensitivity of Abbott IgG assay was 96.5% showing an excellent agreement with the two rapid tests (κ = 0.947 and κ = 0.936 for NGTest ® and Covid-Presto® test, respectively). An excellent agreement was also observed between the two rapid tests (κ = 0.937). Specificity for IgM was 100% and 86.5% for Covid-Presto® test and NG-Test®, respectively. Specificity for IgG was 92.0%, 94.9% and 96.5% for Covid-Presto®, NGTest ®, and Abbott, respectively. Most of the false positive results observed with NG-Test® resulted from samples containing malarial antibodies. In conclusion, performances of these 2 rapid tests are very good and comparable to those obtained with automated immunoassay, except for IgM specificity with the NG-Test®. Thus, isolated IgM should be cautiously interpreted due to the possible false-positive reactions with this test. Finally, before their large use, the rapid tests must be reliably evaluated with adequate and large panel including early seroconversion and possible cross-reactive samples

SARS-CoV-2 antibodies. This study was performed with: (i) a positive panel constituted of 88 SARS-CoV-2 specimens collected from patients with a positive SARS-CoV-2 RT-PCR, , in particular patients   presenting strong COVID-19 suspicions with negative PCR. Serological tests also make it   possible to catch up later with undiagnosed people at time of active infection, since antibodies have been found in almost all people who have been in contact with SARS-CoV-2 within a variable period depending on the severity of the infection [1, 2] . Furthermore, studies showed that the kinetics of appearance of IgM and IgG were relatively close [3] .

Two types of tests are available to detect anti-SARS-CoV-2 antibodies: rapid lateral flow tests and automated immunoassays. Several studies have assessed analytical performances of the automated immunoassays [4] [5] [6] [7] . On the other hand, although a very large number of rapid tests have been developed, few of them have been reliably evaluated with a suitable serum panel. However, this is very important to have data about the efficacy of these rapid tests to reliably detect anti-SARS-CoV-2 antibodies, since their increasing use in the world.

The aim of this study was to assess the analytical performances (sensitivity and specificity) and agreement of two rapid tests and one automated immunoassay for detecting antibodies against SARS-CoV-2. In addition, we assessed five samples containing autoantibodies (four rheumatoid factor and one systemic lupus erythematosus).

We also assessed the serum of 54 health-care workers who presented clinical symptoms during the epidemic period for whom SARS-CoV-2 RT-PCR was negative or not carried out.

We evaluated two lateral flow tests: Covid-Presto ® test rapid Covid-19 IgG/IgM (AAZ, Boulogne-Billancourt, France) and NG-Test ® IgM-IgG COVID-19 (NG Biotech, Guipry, France) according to the manufacturer's instructions. Five and ten microliters of serum for Covid-Presto ® test and NG-Test ® , respectively, were added and results were read and interpreted 10 minutes after depositing serum.

Abbott SARS-CoV-2 IgG kit (chemiluminescent microparticle immunoassay) (Abbott, IL, USA) was performed according to the manufacturer's instructions. The assay cut-off is an index of 1.40 and the assigned grey zone is comprised between 1.12 and 1.68.

All statistical analyses were performed using Excel. To assess sensitivity, RT-PCR results were chosen as gold standard. Cohen kappa statistics and absolute agreement were calculated to evaluate the agreement between the different tests.

All participants were not opposed to the collection of their data.

Sensitivity of Covid-Presto ® test was assessed on 88 samples collected between day 4 and day 42 after onset of symptoms and sensitivity of the NG-Test ® was assessed on a subgroup of 59 samples among the 88 samples tested with Covid-Presto ® test, collected between days 7 and 28 after onset of symptoms ( Table 1) .

Sensitivity of Covid-Presto ® test for IgM was 67% (n=12/18), 88% (n=29/33) and 76% (n=28/37) for samples collected between days 4 and 9, between days 10 and 14, and after 14 days after onset of symptoms, respectively. Sensitivity of Covid-Presto ® test for IgG was 72% (n=13/18), 94% (n=31/33) and 100% (n=37/37) for samples collected between days 4 and 9, between days 10 and 14, and after 14 days after onset of symptoms, respectively. When combining IgM and IgG, sensitivity of Covid-Presto ® test was 83% (n=15/18), 97% (n=32/33) and 100% (n=37/37) for samples collected between days 4 and 9, between days 10 and 14, and after 14 days after onset of symptoms, respectively.

Sensitivity of NG-Test ® for IgM was 83% (n=5/6), 100% (n=22/22) and 97% (n=30/31) for samples collected between days 7 and 9 after, between days 10 and 14, and after 14 days after J o u r n a l P r e -p r o o f onset of symptoms, respectively. Sensitivity of NG-Test ® test for IgG was 83% (n=5/6), 96% (n=21/22) and 97% (n=30/31) for samples collected between days 7 and 9, between days 10 and 14, and after 14 days after onset of symptoms, respectively. When combining IgM and IgG, sensitivity of NG-Test ® test was 83% (n=5/6), 100% (n=22/22) and 97% (n=30/31) for samples collected between days 7 and 9, between days 10 and 14, and after 14 days after onset of symptoms, respectively.

Among the 59 serum samples of this PCR positive panel tested by the two rapid tests, 57 were compared with Abbott SARS-CoV-2 IgG automated immunoassay. Sensitivity of Abbott IgG test was 67% (n=4/6), 100% (n=22/22) and 100% (n=29/29) for samples collected between days 7 and 9, between days 10 and 14, and after 14 days after onset of symptoms, respectively.

Agreement between Abbott assay and rapid tests (IgM/IgG combined) was of 96.5% (n=55/57). In one case, the two rapid tests detected IgG that were not detected by Abbott (index=0.94), this sample was collected between days 7 and 9 after symptoms onset. For the second case, IgG were detected in the greyzone of Abbott (index=1.45) but not by NG-Test ® . This latter sample was collected between days 10 and 14 after symptoms onset and IgM were positive with the two rapid tests.

Specificity of Covid-Presto ® test was assessed on 120 samples described in the methods section. Specificity of NG-Test ® and Abbott assay was assessed on a subgroup of 52 samples among the 120 samples tested with Covid-Presto ® test ( Table 1) . NPV was 97.5%, 95.9% and 94.3% for Covid-Presto ® , NG-Test ® and Abbott, respectively.

In the present study, we evaluated two different lateral flow tests (Covid-Presto ® and NG-Test ® ) and compared their performances to that of the automated Abbott immunoassay using the same samples panel.

Sensitivity has been assessed using a panel of 88 serum samples of COVID-19-infected patients (confirmed with a positive PCR), serum was collected between day 4 and day 42 after symptoms onset. Sensitivity for IgM, among the samples collected before day 9 after symptoms onset, was 67% and 83% for Covid-Presto ® test and NG-Test ® , respectively. In the recent study of Nicol et al., they found sensitivity of NG-Test for IgM of 43.8% for the samples collected before day 7 after symptoms onset and of 81.8% among all samples [5] .

The excellent sensitivity of Covid-Presto ® test observed in our study confirmed the findings of the Prazuck et al. study showing 100% of sensitivity in samples collected more than 15 days after symptoms [8] .

Among some samples collected before day 10 after symptoms onset, a simultaneous detection of IgM and IgG antibodies has been detected. These findings are in line with the antibodies kinetics described for IgM and IgG also using lateral flow rapids, as previously described with other techniques [3] . In the present study for Covid-Presto ® test, it allowed to increase the sensitivity from 67% when only IgM are taken into account to 83% when both IgM and IgG are taken into account, highlighting the important added value to interpret the rapid tests by combining IgM and IgG antibodies.

Sensitivity for IgG in samples collected later than 10 days after symptoms onset was excellent with the different tests being equal to 97.1%, 96.2% and 100% for Covid-Presto ® , NG-Test ® , and Abbott, respectively. Thus, both rapid tests showed an excellent sensitivity for IgG with a very good agreement with Abbott. A previous study assessing Abbott test performance J o u r n a l P r e -p r o o f showed sensitivity of 100% for IgG for samples collected after 15 days after symptoms onset and of 69% for samples collected between 9 and 14 days after symptoms onset [6] . In this latter study, results sensitivity for IgG were similar using NG-Test ® [6] . In another study, IgG sensitivity of Abbott test was 91.8% for patients hospitalized 15 days after symptoms onset and 95.7% for patients non-hospitalized 20 days after symptoms onset.

A limitation of our study could be that most of the patients of the positive panel presented severe infections, since 74% of them were hospitalized in infectious disease unit or in intensive care. Interestingly, among the 14 out-patients, samples were collected for 9 of them 10 days after symptoms onset, showing positive IgM and/or IgG in seven cases with Covid-Presto ® test. Insufficient quantity of serum for these patients was available to also test with NG-Test ® and Abbott. Previous studies have reported that the kinetics and intensity of immune response could differ depending on the disease severity [1, 2] , thus it will be needed to also evaluate rapid tests in mild and pauci-symptomatic patients. Another limitation is the difference in the number of tested samples for the early panel (serum samples collected before 9 days after symptoms onset) between the two rapid tests that which can bias the comparison between these tests for this group. A limitation is that we make this evaluation from serum samples and not from capillary blood specimens.

Regarding specificity evaluation, a crucial point for rapid tests, we used a large panel with 120 pre-endemic samples including 64 representatives of different profiles that can generate possible cross-reactivity. In our study, we showed an excellent specificity, above 96% in all cases and equal to 100% for IgM with Covid-Presto ® test. The excellent specificity of Covid-Presto ® test was also observed in the study of Prazuck et al. [8] . In our study, the only issue regarding specificity is for IgM with NG-Test ® , since specificity is only of 86.5%. However, this low specificity is mainly due to cross-reactivity with sera containing reactivity malarial antibodies. In the study of Nicol et al. IgM specificity with NG-Test ® was 95.3% [5] , higher J o u r n a l P r e -p r o o f than in our study, however their negative panel contained no serum with malaria antibodies.

Regarding automated immunoassay, we showed a very good specificity of 96.2% for IgG with Abbott, confirming previous results of 99.3%, 99.6% and 100% [9] . Serum samples containing malarial antibodies are absent or underrepresented in the negative panel of the other studies, although they are known to generate possible cross reactivity. This is very important to include it in the negative panel, since this is a differential diagnosis in patients returning from malaria endemic region with Flu-like symptoms. Overall, in our study, we observed a very good PPV and NPV for both rapid tests.

In conclusion, analytical performances for detection of anti-SARS-CoV-2 IgG antibodies by two lateral flow rapid tests are very good and quite comparable to those obtained with automated immunoassay. However, serological tests should be used after day 10 following symptoms onset. Before this, RT-PCR is the gold standard test for COVID-19 diagnosis. The interpretation by combining IgM and IgG increased sensitivity of rapid tests. The presence of isolated IgM should be cautiously interpreted due to the possible false-positive reactions.

Finally, the rapid tests must be reliably evaluated with adequate and large panels including early seroconversion and possible cross-reactive samples, before their large use and particular interest in low-resource settings.

Antibody responses to SARS-CoV-2 in patients with COVID-19

Different longitudinal patterns of nucleic acid and serology testing results based on disease severity of COVID-19 patients

Interpreting diagnostic tests for SARS-CoV-2

INMICovid-19 laboratory team, Performance evaluation of Abbott ARCHITECT SARS-CoV-2 IgG immunoassay in comparison with indirect immunofluorescence and virus microneutralization test

Assessment of SARS-CoV-2 serological tests for the diagnosis of COVID-19 through the evaluation of three immunoassays: Two automated immunoassays (Euroimmun and Abbott) and one rapid lateral flow immunoassay (NG Biotech)

immunoassays in comparison with microneutralisation

Clinical evaluation of serological IgG antibody response on the Abbott Architect SARS-CoV-2 infection

Evaluation of performance of two SARS-CoV-2 Rapid whole-blood finger-stick IgM-IgG combined antibody tests

Saint-Louis CORE (COvid REsearch) group, Evaluation of COVID-19 IgG/IgM Rapid Test from Orient Gene Biotech


