Archives of Academic Emergency Medicine. 2021; 9(1): e9 https://doi.org/10.22037/aaem.v9i1.1045 LE T T E R TO ED I TO R Discrepancy in Screening Performances of Different Rapid Test Kits for SARS-CoV-2; a Letter to Editor Phee Kheng Cheah1∗ Darlene F. Ongkili2, Fatin Salwani Zaharuddin1, Muammar Iqbal Hashim1, Chiak Vun Ho3, Heng Gee Lee4, Phaik Kin Cheah5 1. Emergency and Trauma Department, Sabah Women and Children’s Hospital, Ministry of Health, Kota Kinabalu, Sabah, Malaysia. 2. Emergency and Trauma Department, Queen Elizabeth Hospital, Ministry of Health, Kota Kinabalu, Sabah, Malaysia. 3. Department of Pathology, Queen Elizabeth Hospital, Ministry of Health, Kota Kinabalu, Sabah, Malaysia. 4. Infectious Disease Unit, Queen Elizabeth Hospital, Ministry of Health, Kota Kinabalu, Sabah, Malaysia. 5. Faculty of Arts and Social Science, Universiti Tunku Abdul Rahman, Perak, Malaysia. Received: November 2020; Accepted: November 2020; Published online: 13 December 2020 Cite this article as: Cheah PK, Ongkili DF, Zaharuddin FS, Hashim MI, Ho CV, Lee HG, Cheah PK. Discrepancy in Screening Performances of Different Rapid Test Kits for SARS-CoV-2; a Letter to Editor. Arch Acad Emerg Med. 2021; 9(1): e9. Dear Editor, Point-of-care testing has always been an attractive modality to quickly confirm diagnosis in the emergency department (ED). This attribute is highly valuable during the current Coronavirus Disease 2019 (COVID-19) pandemic caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS- CoV-2), where early diagnosis means quicker case detection and earlier isolation. Rapid test kits (RTKs) developed to diagnose COVID-19 utilised two types of assay to detect SARS-CoV-2 infection(1). Molecular assays detect antigen in the form of viral RNA or protein on the patient’s respiratory tract, whilst serology immunoassays are used to detect IgM and IgG antibodies in the blood. There are many RTKs available commercially, but reports on effectiveness are scarce. We share the results of our study, which evaluated three colloidal gold-based immunoassay RTKs available in our centre (Sabah Women and Children’s Hospital, Kota Kinabalu, Malaysia). We conducted an observational quantitative study in April 2020, after ethics approval was received from the Medical Research & Ethics Committee, Ministry of Health, Malaysia (Ethics approval number: NMRR-20-640-54491). The partici- pants selected for this study were relatively well patients who were confirmed to be positive for COVID-19 using reverse transcriptase polymerase chain reaction (RT-PCR) testing ∗Corresponding Author: Phee Kheng Cheah; Emergency and Trauma Depart- ment, Sabah Women and Children’s Hospital, Locked Bag 187, 88986 Kota Kin- abalu, Sabah, Malaysia. Email: pkheng1@yahoo.com, Tel: +6016-8108384, OR- CID: https://orcid.org/0000-0002-2523-2997. on nasopharyngeal samples from contact screening. These patients were categorized based on their epidemiological link as well as if they were symptomatic or asymptomatic on their initial arrival to the ward. The three RTKs available in our centre were assigned as RTK1, RTK2 and RTK3. After obtaining consent, capillary sampling was performed and applied on the RTK. The result was read at 15 minutes as per kit’s instructions and recorded on the data collection form. The researchers then proceeded to complete the patient characteristics section and sampling details section of the data collection form. Patient characteristics included age, gender, comorbidities, date of admission, and patient presentation. Sampling details included date and result of RT-PCR test. Data were entered and analysed using Microsoft Excel Version 16.0. Since this study used detection of IgM and IgG antibodies, it is reasonable to determine the time gap between illness onset and result positivity. However, since onset of illness was unclear, time gap was defined as time between date of positive RT-PCR and the date RTK was conducted (PCR-RTK time gap). In total, we tested 23 patients (52.17% female). RTK1 was tested on 11 patients. RTK2 and RTK3 were tested simulta- neously on the same 12 patients (Table 1). Participants’ age for RTK1 ranged from 12 to 70 years, and for RTK2/ RTK3, it ranged from 14 to 58 years. About half of the total partici- pants (12/23 or 52%) were asymptomatic on presentation. The PCR-RTK time gap for RTK1 ranged from 18 to 34 days (median 26 days), whilst for RTK2 and RTK3, it ranged from 13 to 38 days (median 25.5 days). Using RTK1, 5/11 (45.4%) patients produced positive IgG results, and 1/11 (0.1%) patients showed positive IgM result This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem P. Kheng Cheah and et. al 2 (Figure 1). More patients (10/12 or 83.3%) had positive IgG results using RTK3, but only one patient (0.08%) produced positive IgM result. Results were all negative for both IgM and IgG using RTK2. Only one patient tested positive for both IgM and IgG antibodies using RTK3. Both positive IgM results were at day 29 after RT-PCR result was positive. Fifty three percent (9/17) of positive RTK results were observed at day 21 to 30 after the diagnosis was confirmed by RT-PCR. Based on our observations, patients tested IgG positive ear- lier using RTK3 compared to RTK1. Secondly, RTK2 did not produce positive results at all when RTK3 did. This reflects discrepancy in the performance of different RTKs. In China, one study tested patients using combined IgG and IgM RTK. The RTK was 88.7% sensitive and 90.6% specific (2). While these figures seemed promising, a study using RTK in an ED in Italy revealed a poor sensitivity of 18.4% and 91.7% specificity, making the RTK unreliable to diagnose COVID-19 (3). Possible explanation includes differences in antibody detection limit between RTKs, undetectable low antibody titre during early stages of infection, and individual immune response such as immunocompromised states (2-4). These individual factors may be the reason why some patients tested negative for both IgM and IgG antibodies up to 26 days after a positive RT-PCR result (Table 1). The time gap for the majority of IgG positive patients was 11 to 30 days from positive RT-PCR results (Figure 1). This is an expected finding since IgG production is usually delayed. However, two patients tested IgM positive at 29 days. While it is generally understood that IgM is produced acutely and disappears two weeks after onset, research showed that in COVID-19 infection, IgM and IgG production peaks in the third and fourth week (5), which corresponded to the time frame of our patients’ results. This study is limited by the small sample size. Patient testing was based on convenience due to unpredictable kit availability, which only allowed re- searchers to use whichever kit was available in the laboratory at the time of testing. In conclusion, the RTKs tested in this study yielded incon- sistent results. Health care providers and administrators should be aware that not all RTKs produce accurate and reliable results. This warrants standardisation and fine tuning of COVID-19 RTKs. We suggest that pilot testing be done prior to selecting an RTK for use to ensure that they produce intended results. In fact, at the time of writing, the RTK2 batch used was recalled by its manufacturer due to faulty product following complaints from end-user. As enticing as it may be, health care authorities must consider this diagnostic option carefully and wisely. 1. Declarations 1.1. Acknowledgement The authors would like to thank the Director General of Health Malaysia for the permission to publish this paper. 1.2. Authors’ contributions PKC, CVH, HGL and PKC5 conceived and planned the study. FSZ, MIH, DFO and HGL collected the data and computed the findings. DFO and PKC5 wrote the letter. PKC and CVH were in charge of overall direction and planning. All authors discussed the findings and commented on the manuscript. 1.3. Funding and supports The author(s) received no financial support for the research, authorship, and/or publication of this article. 1.4. Conflict of interest None. 1.5. Funding and support None. References 1. Vashist SK. In Vitro Diagnostic Assays for COVID-19: Recent Advances and Emerging Trends. Diagnostics. 2020;10(4):202. 2. Li Z, Yi Y, Luo X, Xiong N, Liu Y, Li S, et al. Development and clinical application of a rapid IgM-IgG combined an- tibody test for SARS-CoV-2 infection diagnosis. Journal of Medical Virology. 2020;92(9):1518-24. 3. Cassaniti I, Novazzi F, Giardina F, Salinaro F, Sachs M, Per- lini S, et al. Performance of VivaDiag COVID-19 IgM/IgG Rapid Test is inadequate for diagnosis of COVID-19 in acute patients referring to emergency room department. Journal of Medical Virology. 2020;92(10):1724-7. 4. Xiao AT, Gao C, Zhang S. Profile of specific antibodies to SARS-CoV-2: The first report. Journal of Infection. 2020;81(1):147-78. 5. Du Z, Zhu F, Guo F, Yang B, Wang T. Detection of antibodies against SARS-CoV-2 in patients with COVID-19. Journal of Medical Virology. 2020;92(10):1735-8. This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem 3 Archives of Academic Emergency Medicine. 2021; 9(1): e9 Table 1: Results of three different rapid test kits (RTKs) of COVID-19 on 23 confirmed patients via Rt-PCR Age Gender Presentation PCR-RTK Time Gap RTK1 RTK2 RTK3 IgM IgM IgM IgM IgM IgM 52 Male Symptomatic exposure 13 Negative Negative Negative POSITIVE 25 Female Asymptomatic close contact 15 Negative Negative Negative Negative 26 Female Asymptomatic exposure 15 Negative Negative Negative POSITIVE 47 Female Asymptomatic exposure 15 Negative Negative Negative Negative 43 Female Symptomatic exposure 15 Negative Negative Negative POSITIVE 48 Female Asymptomatic exposure 16 Negative Negative Negative POSITIVE 53 Female Symptomatic exposure 16 Negative Negative Negative POSITIVE 14 Male Symptomatic close contact 18 Negative Negative 21 Female Symptomatic close contact 19 Negative Negative 12 Male Asymptomatic close contact 21 Negative POSITIVE 33 Female Asymptomatic close contact 21 Negative POSITIVE 21 Male Asymptomatic close contact 21 Negative Negative 58 Male Symptomatic travel history 24 Negative POSITIVE 21 Male Asymptomatic mass gathering 24 Negative Negative Negative POSITIVE 28 Female Symptomatic mass gathering 25 Negative Negative 70 Female Asymptomatic close contact 25 Negative POSITIVE 44 Female Symptomatic travel history 26 Negative Negative 58 Male Symptomatic travel history 27 Negative Negative Negative POSITIVE 61 Female Asymptomatic close contact 29 POSITIVE Negative 42 Male Symptomatic exposure 29 Negative Negative POSITIVE POSITIVE 14 Male Asymptomatic mass gathering 32 Negative Negative Negative POSITIVE 65 Male Asymptomatic close contact 34 Negative POSITIVE 26 Male Symptomatic mass gathering 38 Negative Negative Negative POSITIVE This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem P. Kheng Cheah and et. al 4 Figure 1: Positive results produced by RTKs based on the PCR-RTK time gap. Only positive RTK1 and RTK3 results were included in this chart. All results for RTK2 were negative and thus omitted from this chart. This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem Declarations References