Performance comparison between Elecsys Anti-SARS-CoV-2 and Anti-SARS-CoV-2 S and Atellica IM SARS-CoV-2 Total and SARS-CoV-2 IgG assays

Seri Jeong; Yoo Rha Hong; Hyunyong Hwang

doi:10.7180/kmj.22.114

Journal List > Kosin Med J > v.37(2) > 1516078075

Go to TopGo to Top Go to BottomGo to Bottom

TOOLS

Jeong, Hong, and Hwang: Performance comparison between Elecsys Anti-SARS-CoV-2 and Anti-SARS-CoV-2 S and Atellica IM SARS-CoV-2 Total and SARS-CoV-2 IgG assays

Original article

Kosin Med J 2022;37(2):154-162.

Published online: 27 June 2022

DOI: https://doi.org/10.7180/kmj.22.114

Performance comparison between Elecsys Anti-SARS-CoV-2 and Anti-SARS-CoV-2 S and Atellica IM SARS-CoV-2 Total and SARS-CoV-2 IgG assays

Seri Jeong^1,^*

, Yoo Rha Hong^2,^*

, Hyunyong Hwang³

¹Department of Laboratory Medicine, Hallym University Kangnam Sacred Heart Hospital, Hallym University College of Medicine, Seoul, Korea

²Department of Pediatrics, Kosin University Gospel Hospital, Kosin University College of Medicine, Busan, Korea

³Department of Laboratory Medicine, Kosin University Gospel Hospital, Kosin University College of Medicine, Busan, Korea

Corresponding Author: Hyunyong Hwang, MD, PhD Department of Laboratory Medicine, Kosin University Gospel Hospital, Kosin University College of Medicine, 262 Gamcheon-ro, Seo-gu, Busan 49267, Korea Tel: +82-51-990-6371 Fax: +82-51-990-3034 E-mail: terminom@hanmail.net

^* These authors contributed equally to this work as first authors.

Received 15 June 2022 Revised 21 June 2022 Accepted 21 June 2022

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Although serological severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) tests from several manufacturers have been introduced in South Korea and some are commercially available, the performance of these test kits has not yet been sufficiently validated. Therefore, we compared the performance of Elecsys Anti-SARS-CoV-2 (ACOV2) and Anti-SARS-CoV-2 S (ACOV2S) and Atellica IM SARS-CoV-2 Total (COV2T) and SARS-CoV-2 IgG (sCOVG) serological tests in this study.

Methods

A total of 186 patient samples were used. For each test, we analyzed the positive rate of serological antibody tests, precision, linearity, and agreement among the four assays.

Results

The positive rates of COV2T, sCOVG, and ACOV2S were high (81.7%–89.2%) in total, with those for ACOV2S being the was the highest, while those of ACOV2 were as low as 44.6%. This may be related to the high completion rate of vaccination in Korea. The repeatability and within-laboratory coefficients of variation were within the claimed allowable imprecision; however, further research is needed to establish an allowable imprecision at low concentrations. COV2T showed a linear fit, whereas sCOVG and ACOV2S were appropriately modeled with a nonlinear fit. Good agreement was found among COV2T, sCOVG, and ACOV2S; however, the agreement between ACOV2 and any one of the other methods was poor.

Conclusions

Considering the different antigens used in serological SARS-CoV-2 antibody assays, the performance of the tested assays is thought to show no significant difference for the qualitative detection of antibodies to SARS-CoV-2.

Keywords: COVID-19, Nucleocapsid proteins, Quantitative evaluations, SARS-CoV-2, Serological test

Introduction

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has been in the spotlight as the causative agent of coronavirus disease 2019 (COVID-19) since pneumonia patients were confirmed to be infected with a novel coronavirus in December 2019 [1,2]. The manifestations of SARS-CoV-2 infection can be various, spanning from an asymptomatic status to lethal complications [3,4]. As COVID-19 has been declared a global pandemic and spreads rapidly, accurate diagnosis is very important to control the pandemic.

Although a variety of laboratory tests are used for a differential diagnosis, real-time reverse transcription-PCR (RT-PCR) has been considered the gold standard to identify SARS-CoV-2 in clinical practice [5-7]. On the other hand, in serological testing, such as testing for SARS-CoV-2, antibody tests have been known to raise heterogeneity issues and limit identifying SARS-CoV-2 in the early stages of illness [8]. Antibody tests are primarily used to determine if a person has previously been infected with COVID-19 [9].

SARS-CoV-2 has four main structural proteins; spike (S), envelope (E), membrane (M), and nucleocapsid (N) proteins [10]. It has been reported that the S protein binds to the angiotensin-converting enzyme 2 (ACE2) to enter the host cell present on the surface of alveolar type II cells of the lung and epithelial cells of the oral mucosa [11-13]. The S protein has a subunit S1 harboring receptor-binding domains (RBD) which interacts with ACE2 [14,15]. These proteins, especially the S and N proteins, have been used as target antigens for the development of serological SARS-CoV-2 detection tests [16].

The antigens of Atellica IM SARS-CoV-2 Total (COV2T) and SARS-CoV-2 Immunoglobulin (Ig) G (sCOVG) antibody tests (Siemens Healthcare Diagnostics Inc., Tarrytown, NY, USA) target the S protein, while Elecsys Anti-SARS-CoV-2 (ACOV2) and Anti-SARS-CoV-2 S (ACOV2S) antibody tests (Roche Diagnostics International, Rotkreuz, Switzerland) target the N and S proteins, respectively. Although serological SARS-CoV-2 tests from several manufacturers have been introduced in South Korea and some of them are commercially available, the performance of each test kit has not yet been sufficiently validated. Therefore, we compared the performance of ACOV2, ACOV2S, COV2T, and sCOVG serological tests in this study.

Methods

Ethical statements: This study was approved by the Institutional Review Board of the Kosin University Gospel Hospital and informed consent was waived (KUGH 2022-03-038).

1. Preparation of patient samples

We collected leftover serum samples from 186 admitted patients in our hospital. After completing the requested tests from the inpatient clinics, each sample leftover was divided into new tubes and given a new code for the analyses.

2. Serological testing of antibodies to SARS-CoV-2

We used ACOV2 (Roche Diagnostics International), ACOV2S (Roche Diagnostics International), COV2T (Siemens Healthcare Diagnostics Inc.) and sCOVG (Siemens Healthcare Diagnostics Inc.) for the detection of antibodies to SARS-CoV-2. The sCOVG and ACOV2S test kits are immunoassays for the in vitro quantitative detection of IgG and total antibodies to SARS-CoV-2 in human serum and plasma, respectively, while the ACOV2 test qualitatively detects total antibodies to the SARS-CoV-2. The COV2T test is for the in vitro qualitative and semi-quantitative detection of total antibodies, including IgG and IgM antibodies, to SARS-CoV-2. The COV2T, sCOVG, and ACOV2S assays each use recombinant proteins representing the RBD of the S antigen in a sandwich assay format. On the other hand, an antibody to the N recombinant protein is used in the ACOV2 assay [16,17].

In this study, the COV2T and sCOVG tests and the ACOV2 and ACOV2S tests were performed on an Atellica IM automated analyzer (Siemens Healthcare Diagnostics Inc.) and a Cobas 8000 e801 automated analyzer (Roche Diagnostics International), respectively.

3. Positive rate of serological tests in enrolled patients

The enrolled patient group was divided into SARS-CoV-2 RT-PCR positive and negative groups. We calculated the percentage of serological SARS-CoV-2 positive test patients in two PCR testing groups and in the total patients group.

4. Precision analysis

Precision was determined according to the protocols from Clinical and Laboratory Standards Institute (CLSI) EP15-A3 [18]. Quality control materials were used in the precision evaluation. These controls consisted of two concentrations (low and high). The tests were performed at five runs per day for 5 days to calculate the repeatability and within-laboratory precision.

5. Linearity analysis

The protocol from CLSI EP06-A was used for linearity analysis [19]. We prepared two sets of five samples with equally spaced concentrations for the experiments. High and low concentrations of serum samples were prepared and they were mixed proportionally at 0:4, 1:3, 2:2, 3:1, and 4:0. We randomly measured the concentrations of the samples twice. The results were interpreted using the flowchart of EP06-A, which is based on a polynomial evaluation [19].

6. Agreement evaluation

To analyze the correlation between the assays, we used Pearson’s correlation coefficients and Passing-Bablok regression for the slope and intercept. Bland-Altman analysis was performed for the bias (mean difference) and 95% limits of agreement. Concordance rates and κ-values values were determined for the agreements between the methods based on the qualitative test results (positive vs. negative). Each serological SARS-CoV-2 antibody test used its own cutoff value that was claimed by its manufacturer to interpret the test results as positive or negative. The cutoffs for ACOV2, ACOV2S, COV2T, and sCOVG are 0.80 U/mL, 1.0 cutoff index (COI), 1.00 index, and 1.00 index (U/mL), respectively. When the measured serological test values were equal to or greater than the cutoff values, positive tests were reported.

7. Statistical analysis

The precision, linearity, Passing-Bablok regression, and Bland-Altman analyses were performed using Analyze-it for Microsoft Excel version 6.01.1 (Analyze-it Software Ltd., Leeds, UK). The remaining statistical analyses were performed using SPSS version 25 (IBM Corp., Armonk, NY, USA). Pearson correlation was used for the correlation between methods and kappa statistics were used for the agreement analysis. The κ-values are interpreted as follows: 0.00–0.20 for slight agreement; 0.21–0.40 for fair agreement; 0.41–0.60 for moderate agreement; 0.61–0.80 for substantial agreement; and 0.81–1.00 for almost perfect agreement [20]. The differences were considered statistically significant at a p<0.05.

Results

We prospectively analyzed the serum samples from 186 patients (66.2±15.2 years, male/female ratio=1.33), including 115 SARS-CoV-2 RT-PCR positive and 71 PCR negative patients. The 186 tested samples had a sampling date of 5 days or earlier after PCR testing.

1. Positive rate of serological tests in enrolled patients

The patient group was divided into 115 SARS-CoV-2 positive PCR and 71 negative PCR groups. The positive rates of COV2T and ACOV2S were the highest in SARS-CoV-2 RT-PCR positive and negative groups (87.0% and 94.4%, respectively) (Table 1). ACOV2S showed the highest positive rate (89.2%) in total, while the positive rates of ACOV2 were the lowest in SARS-CoV-2 RT-PCR positive and negative groups and in total (43.5%, 46.5%, and 44.6%, respectively).

2. Precision analysis

The repeatability and within-laboratory precision of COV2T, sCOVG, ACOV2, and ACOV2S tests are shown in Table 2. The repeatability and within-laboratory precision of the low concentration material of COV2T and ACOV2S are not presented because all values were below the measuring range (<6.0 U/mL and <0.4 U/mL, respectively). The CVs in the samples of low and high concentration materials ranged from 2.4% to 92.2% and from 1.0% to 2.5%, respectively.

3. Linearity analysis

Since ACOV2 is an immunoassay for the in vitro qualitative detection of antibodies to SARS-CoV-2, linearity analysis was not performed. The measuring intervals of COV2T, sCOVG, and ACOV2S were 0.64–73.56 U/mL, 0.53–141.15 U/mL, and 0.46–174.33 U/mL, respectively. COV2T showed excellent linearity within each analytical measurement range (Fig. 1). As analyzed using the flowchart of CLSI EP06-A, no 2nd or 3rd order polynomial fits were statistically better than a linear fit at the 5% significance concentration for COV2T. However, the 2nd order polynomial fits were statically better than a linear fit for sCOVG (p=0.048) and ACOV2S (p=0.001).

4. Agreement study

In Table 3, the correlation between sCOVG and ACOV2S was the best among the compared methods (r=0.833, p<0.001). The measured values of ACOV2S were greater than those of sCOVG (slope=142.7, intercept=–33.84) and the difference between the two paired methods proportionally increased with increasing concentrations (Fig. 2). COV2T was moderately correlated with sCOVG and ACOV2S (r=0.496, p<0.001 and r=0.413, p<0.001, respectively) (Table 3). The difference between ACOV2S and COV2T measurements showed a proportional increase to the average of the paired methods (Fig. 2). A proportional increase in the difference between COV2T and sCOVG measurements was observed. However, the two-pronged measurements were plotted against the average measurements over concentrations of around 40,000 U/mL (Fig. 2).

The concordance rate between methods was highest between COV2T and ACOV2S (96.8%), where the agreement was almost perfect (κ=0.839, p<0.001) (Table 4). Substantial agreements were observed between COV2T and sCOVG and between sCOVG and ACOV2S (r=0.750, p<0.001 and r=0.700, p<0.001, respectively). The concordance rate and agreement between ACOV2 and either one of the other methods were relatively worse compared to those between other combinations of compared groups (concordance rate and κ-value: 51.5% and 0.096, 53.2% and 0.124, and 51.1% and 0.098 between COV2T and ACOV2, sCOVG and ACOV2, and ACOV2 and ACOV2S, respectively).

Discussion

After all, clinical complications and prognosis are the main concerns in SARS-CoV-2 patients. Therefore, accurate measurement of antibodies to SARS-CoV-2 should help to predict and monitor the clinical manifestations during treatments. Unfortunately, several medications have been introduced worldwide, however, the validity of the treatments seems to be not perfectly proven yet [21-23]. This would make serological antibody tests more valuable for the better prognosis of patients. From this perspective, the performance comparison of this study would provide some insight into serological SARS-CoV-2 antibody tests.

When this study began, a majority of Koreans had completed vaccination for COVID-19 and every admitting patient had to be tested with SARS-CoV-2 RT-PCR to identify if a patient was currently infected with SARS-CoV-2; omicron was the dominant coronavirus variant in South Korea [24]. As a result, almost all enrolled patients were assumed to have experienced either real coronavirus infections or vaccination before admission. Although we collected samples from patients with SARS-CoV-2 positive and negative RT-PCR results, the positive rate of the serological test was highest in the negative RT-PCR group (94.4%) (Table 1). The positive rates of serological tests spanned from 79.1% to 94.4% and those of ACOV2 were relatively low (43.5%–46.5%). Considering that ACOV2 uses a nucleocapsid protein as an antigen and most vaccines used in Korea for inoculation were targeting spike protein in SARS-CoV-2 [25,26], it is assumed that more than half of enrolled patients had not recently been exposed to SARS-CoV-2 and that it is likely that the high positive rates in serological tests were caused by vaccinations. Practically, the seroprevalence of N-specific antibodies has been reported to remain as low as 1.59% after a vaccine campaign in Japan [27].

In Table 2, repeatability and within-laboratory coefficient of variations (CVs) are within the allowable imprecision claimed by manufacturers, except for those in the low concentration control in the sCOVG antibody test. The upper repeatability and within-laboratory CVs claimed by the manufacturer were 12.0% and 15% within the 0.80–2.00 U/mL concentration interval, respectively. The mean of low concentration material was 0.019 U/mL in this study, which is at least a 42.1 times lower concentration. In a previous study, materials over 2.0 U/mL were used for imprecision and the CVs were lower than the manufacturer’s claim [28]. Therefore, further evaluation needs to be performed to establish the imprecision at lower concentrations.

Although nonlinearity was determined in sCOVG and ACOV2S, the degree of nonlinearity of these two methods seemed visually different. The sCOVG test was relatively more linear than the ACOV2S test. When the difference plot was recalculated again when setting the allowable nonlinearity to 15%, which is claimed by manufacturers across the measuring interval, the concentration of nonlinearity was at the left end in both methods. After removing the left endpoint, the degree of nonlinearity was alleviated. As a result, the remaining 4 points were located within the allowable nonlinearity interval and the p-value of the 2nd order polynomial equation increased from 0.001 to 0.018 for the ACOV2S test (data not shown), which indicates that the degree of nonlinearity was more alleviated than before. Likewise, after removing left endpoint of the sCOVG test, the p-value of the 2nd order polynomial equation was changed from 0.048 to 0.747 (data not shown), which is more appropriate for a linear fit. Instead of establishing linearity, the range of the measuring interval should be reduced. Although COV2T has been claimed to be a semi-quantitative test, its linearity was good.

In the Passing-Bablok analysis, the slopes of regression lines were 0.041 and 142.7 between COV2T and sCOVG and between sCOVG and ACOV2S, respectively. This indicates that the absolute concentration of reported test results should be greatly different depending on the methods. Although the compared three methods detect different antibodies, test harmonization issues need to be raised. Significant differences between plasma- and serum-based SARS-CoV-2 antibody tests have already been reported [29].

The correlation and agreement were best between sCOVG and ACOV2S antibody tests (r=0.833, κ=0.839, p<0.001) (Tables 2, 3). Although the cutoffs of positive for anti-SARS-CoV-S in sCOVG and ACOV2S are not markedly different (0.80 U/mL and 1.0 U/mL, respectively), the difference in the absolute concentration between them showed a proportionally increasing trend as the concentration of antibodies increased. This might happen because constant CV% was affected across the measuring interval, which would show a linear slope. This could be caused by a calibration error in one method [30,31]. Since the manifestation of a regression line between ACOV2S and COV2T is different from the other paired methods, it is not easy to confirm if this is due to a proportional constant error, such as a calibration error.

Serological SARS-CoV-2 antibody tests require a careful interpretation in clinical practice because the sensitivity of the serological tests varies depending on the days after disease onset [32]. The cumulative seroprevalence for IgM and IgG increased from 44% and 56% on day 7 after symptom onset to over 95% on day 20 for IgM and day 16 for IgG, respectively [33]. The enrolled patient samples did not contain clinical information except for the age, sex, and SARS-CoV-2 RT-PCR results in this study. Furthermore, the majority of admitted patients had already completed vaccination when samples were obtained from patients. Therefore, the diagnostic validity of the assays could not be evaluated due to the lack of linked clinical information.

In conclusion, the positive rates of COV2T, sCOVG, and ACOV2S were as high as 81.7%–89.2% in total, and that for ACOV2S was the highest, while those of ACOV2 were as low as 44.6%. This may be related to the high completion rate of vaccination in Korea. The precision results were allowable based on the claimed allowable imprecision, however, further study needs to be conducted to establish the allowable imprecision at a lower concentration level. COV2T showed a linear fit, on the other hand, sCOVG and ACOV2S were appropriately modeled with a nonlinear fit. The agreements among COV2T, sCOVG, and ACOV2S were good, however, those between ACOV2 and either one of the other methods were poor, which is assumed to be due to the different antigens in methods. Considering the different adopted antigens that the serological SARS-CoV-2 antibody assays use, the performance of tested assays is thought to show no significant difference for the qualitative detection of antibodies to SARS-CoV-2.

Notes

Conflicts of interest

Seri Jeong and Hyunyong Hwang are editorial board members of the journal but were not involved in the peer reviewer selection, evaluation, or decision process of this article. No other potential conflicts of interest relevant to this paper were reported.

Funding

This research was supported by Roche Diagnostics and Siemens Healthineers companies in 2022. The funders had no role in study design, analysis, interpretation or publication. We declare that we have no financial conflicts of interest.

Author contributions

Conceptualization: HH. Data curation: SJ, YRH, HH. Formal analysis: HH. Funding acquisition: HH. Investigation: SJ, YRH. Methodology: HH. Project administration: HH. Supervision: HH. Validation: HH. Visualization: SJ, YRH. Writing - original draft: SJ, YRH. Writing - review & editing: HH. Approval of final manuscript: all authors.

References

1. Ye ZW, Yuan S, Yuen KS, Fung SY, Chan CP, Jin DY. Zoonotic origins of human coronaviruses. Int J Biol Sci. 2020; 16:1686–97.

2. Pal M, Berhanu G, Desalegn C, Kandi V. Severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2): an update. Cureus. 2020; 12:e7423.

3. Safiabadi Tali SH, LeBlanc JJ, Sadiq Z, Oyewunmi OD, Camargo C, Nikpour B, et al. Tools and techniques for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2)/COVID-19 detection. Clin Microbiol Rev. 2021; 34:e00228–20.

4. Jolobe OMP. What are the criteria for asymptomatic status? QJM. 2021; 114:351–2.

5. LeBlanc JJ, Gubbay JB, Li Y, Needle R, Arneson SR, Marcino D, et al. Real-time PCR-based SARS-CoV-2 detection in Canadian laboratories. J Clin Virol. 2020; 128:104433.

6. Bhimraj A, Morgan RL, Shumaker AH, Lavergne V, Baden L, Cheng VC, et al. Infectious Diseases Society of America Guidelines on the treatment and management of patients with COVID-19. Clin Infect Dis. 2020 Apr 27 [Epub]. https://doi.org/10.1093/cid/ciaa478.

7. Stegeman I, Ochodo EA, Guleid F, Holtman GA, Yang B, Davenport C, et al. Routine laboratory testing to determine if a patient has COVID-19. Cochrane Database Syst Rev. 2020; 11:CD013787.

8. Nakagama Y, Komase Y, Candray K, Nakagama S, Sano F, Tsuchida T, et al. Serological testing reveals the hidden COVID-19 burden among health care workers experiencing a SARS-CoV-2 nosocomial outbreak. Microbiol Spectr. 2021; 9:e0108221.

9. Moura DTH, McCarty TR, Ribeiro IB, Funari MP, Oliveira PVAG, Miranda Neto AA, et al. Diagnostic characteristics of serological-based COVID-19 testing: a systematic review and meta-analysis. Clinics (Sao Paulo). 2020; 75:e2212.

10. Kadam SB, Sukhramani GS, Bishnoi P, Pable AA, Barvkar VT. SARS-CoV-2, the pandemic coronavirus: Molecular and structural insights. J Basic Microbiol. 2021; 61:180–202.

11. Letko M, Marzi A, Munster V. Functional assessment of cell entry and receptor usage for SARS-CoV-2 and other lineage B betacoronaviruses. Nat Microbiol. 2020; 5:562–9.

12. Xu H, Zhong L, Deng J, Peng J, Dan H, Zeng X, et al. High expression of ACE2 receptor of 2019-nCoV on the epithelial cells of oral mucosa. Int J Oral Sci. 2020; 12:8.

13. Zhou P, Yang XL, Wang XG, Hu B, Zhang L, Zhang W, et al. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature. 2020; 579:270–3.

14. Du L, He Y, Zhou Y, Liu S, Zheng BJ, Jiang S. The spike protein of SARS-CoV: a target for vaccine and therapeutic development. Nat Rev Microbiol. 2009; 7:226–36.

15. Saputri DS, Li S, van Eerden FJ, Rozewicki J, Xu Z, Ismanto HS, et al. Flexible, functional, and familiar: characteristics of SARS-CoV-2 spike protein evolution. Front Microbiol. 2020; 11:2112.

16. Hwang YC, Lu RM, Su SC, Chiang PY, Ko SH, Ke FY, et al. Monoclonal antibodies for COVID-19 therapy and SARS-CoV-2 detection. J Biomed Sci. 2022; 29:1.

17. Giavarina D, Carta M. Improvements and limits of anti SARS-CoV-2 antibodies assays by WHO (NIBSC 20/136) standardization. Diagnosis (Berl). 2021; 9:274–9.

18. Aguirre JJ, Ness K; Algeciras-Schimnich A. Application of the CLSI EP15-A3 guideline as an alternative troubleshooting tool for verification of assay precision. Am J Clin Pathol. 2019; 152(Suppl 1):S88.

19. Tholen DW, Kroll M, Astles JR, Caffo AL, Happe TM, Krouwer J, et al. Evaluation of the linearity of quantitative measurement procedures: a statistical approach; approved guideline. Wayne: Clinical and Laboratory Standards Institute;2003.

20. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; 33:159–74.

21. Nittari G, Pallotta G, Amenta F, Tayebati SK. Current pharmacological treatments for SARS-COV-2: a narrative review. Eur J Pharmacol. 2020; 882:173328.

22. Trougakos IP, Stamatelopoulos K, Terpos E, Tsitsilonis OE, Aivalioti E, Paraskevis D, et al. Insights to SARS-CoV-2 life cycle, pathophysiology, and rationalized treatments that target COVID-19 clinical complications. J Biomed Sci. 2021; 28:9.

23. Tiwari N, Upadhyay J, Ansari MN, Joshi R. Novel β-coronavirus (SARS-CoV-2): current and future aspects of pharmacological treatments. Saudi Pharm J. 2020; 28:1243–52.

24. Kim MK, Lee B, Choi YY, Um J, Lee KS, Sung HK, et al. Clinical characteristics of 40 patients infected with the SARS-CoV-2 Omicron variant in Korea. J Korean Med Sci. 2022; 37:e31.

25. Leuzinger K, Osthoff M, Drager S, Pargger H, Siegemund M, Bassetti S, et al. Comparing immunoassays for SARS-CoV-2 antibody detection in patients with and without laboratory-confirmed SARS-CoV-2 infection. J Clin Microbiol. 2021; 59:e0138121.

26. Kim MA, Lee YW, Kim SR, Kim JH, Min TK, Park HS, et al. COVID-19 vaccine-associated anaphylaxis and allergic reactions: consensus statements of the KAAACI Urticaria/Angioedema/Anaphylaxis Working Group. Allergy Asthma Immunol Res. 2021; 13:526–44.

27. Igawa G, Ai T, Yamamoto T, Ito K, Nojiri S, Saito K, et al. Antibody response and seroprevalence in healthcare workers after the BNT162b2 vaccination in a University Hospital at Tokyo. Sci Rep. 2022; 12:8707.

28. Florin L, Maelegheer K, Vandewal W, Bernard D, Robbrecht J. Performance evaluation of the Siemens SARS-CoV-2 Total Antibody and IgG Antibody Test. Lab Med. 2021; 52:e147–3.

29. Haselmann V, Kittel M, Gerhards C, Thiaucourt M, Eichner R, Costina V, et al. Comparison of test performance of commercial anti-SARS-CoV-2 immunoassays in serum and plasma samples. Clin Chim Acta. 2020; 510:73–8.

30. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986; 1:307–10.

31. Giavarina D. Understanding Bland Altman analysis. Biochem Med (Zagreb). 2015; 25:141–51.

32. Gao J, Quan L. Current status of diagnostic testing for SARS-CoV-2 infection and future developments: a review. Med Sci Monit. 2020; 26:e928552.

33. Xu X, Sun J, Nie S, Li H, Kong Y, Liang M, et al. Seroprevalence of immunoglobulin M and G antibodies against SARS-CoV-2 in China. Nat Med. 2020; 26:1193–5.

Fig. 1.

Linearity of COV2T, sCOVG, and ACOV2S using Cobas 8000 e801 and Atellica IM automated analyzers. The COV2T (A) and sCOVG (B) were tested on an Atellica IM automated analyzer, the ACOV2S (C) being tested on a Cobas 8000 e801 automated analyzer. The COV2T showed excellent linearity within each analytical measurement range, therefore, a difference plot was not presented. SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; COV2T, Atellica IM SARS-CoV-2 Total; sCOVG, Atellica IM SARS-CoV-2 IgG; ACOV2S, Elecsys Anti-SARS-CoV-2 S.

Fig. 2.

Bland-Altman plot for ACOV2S, COV2T and sCOVG. (A-C) Differences are presented as U/mL (left column) and percentage (right column) for each Bland-Altman plot. The mean presents the mean difference between x and y, and the 95% LoA lines indicate the mean difference ±1.96 standard deviation. sCOVG, Atellica IM SARS-CoV-2 IgG; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; COV2T, Atellica IM SARS-CoV-2 Total; ACOV2S, Elecsys Anti-SARS-CoV-2 S; LoA, limits of agreement.

Table 1.

Positive rates of serological tests in SARS-CoV-2 RT-PCR positive and negative patients

Test	Result	No.	Positive rate of serological test (%)
Test	Result	No.	COV2T	sCOVG	ACOV2	ACOV2S
SARS-CoV-2 RT-PCR	Positive	115	87.0	79.1	43.5	86.1
SARS-CoV-2 RT-PCR	Negative	71	90.1	85.9	46.5	94.4
Total		186	88.2	81.7	44.6	89.2

SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; RT-PCR, reverse transcription polymerase chain reaction; COV2T, Atellica IM SARS-CoV-2 Total; sCOVG, Atellica IM SARS-CoV-2 IgG; ACOV2, Elecsys Anti-SARS-CoV-2; ACOV2S, Elecsys Anti-SARS-CoV-2 S.

Table 2.

Repeatability and within-laboratory precisions of 4 SARS-CoV-2 assays

Test	Sample	Repeatability				Within-laboratory precision
		Low		High		Low		High
		Mean±SD (U/mL)	CV (%)	Mean±SD (U/mL)	CV (%)	Mean±SD (U/mL)	CV (%)	Mean±SD (U/mL)	CV (%)
COV2T	QC material	<6.0	-^a)	3.236±0.067	2.1	<6.0	-^a)	3.236±0.067	2.1
sCOVG	QC material	0.019±0.018	92.2	3.748±0.067	1.8	0.019±0.018	92.2	3.748±0.069	1.8
ACOV2	QC material	0.089±0.002^b)	2.4	3.518±0.036	1.0	0.089±0.003	2.9	3.518±0.063	1.8
ACOV2S	QC material	<0.4	-^a)	7.275±0.092	1.3	<0.4	-^a)	7.275±0.181	2.5

SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; SD, standard deviation; CV, coefficient of variation; COV2T, Atellica IM SARS-CoV-2 Total; sCOVG, Atellica IM SARS-CoV-2 IgG; ACOV2, Elecsys Anti-SARS-CoV-2; ACOV2S, Elecsys Anti-SARS-CoV-2 S; QC, quality control.

^a) SDs and CVs could not be determined because the low QC material in the COV2T and ACOV2S had concentrations below the measuring range (<6.0 U/mL and <0.4 U/mL, respectively) throughout the experiment.

^b) The results of ACOV2 were presented as a cutoff index.

Table 3.

Passing-Bablok and Pearson correlation coefficients among COV2T, sCOVG, and ACOV2S

Method x	Method y	Slope	Intercept (U/mL)	r^a)
COV2T	sCOVG	0.041	1.795	0.496
sCOVG	ACOV2S	142.7	–33.840	0.833
ACOV2S	COV2T	6.352	–4.449	0.413

SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; COV2T, Atellica IM SARS-CoV-2 Total; sCOVG, Atellica IM SARS-CoV-2 IgG; ACOV2S, Elecsys Anti-SARS-CoV-2 S; r, Pearson correlation coefficient.

^a) p<0.001.

Table 4.

Concordance rates and agreements among 4 SARS-CoV-2 assays

Comparing group	Concordance rate (%)	Agreement (κ)	p-value
COV2T vs. sCOVG	93.5	0.750	<0.001
COV2T vs. ACOV2	51.5	0.096	0.028
COV2T vs. ACOV2S	96.8	0.839	<0.001
sCOVG vs. ACOV2	53.2	0.124	0.018
sCOVG vs. ACOV2S	92.5	0.700	<0.001
ACOV2 vs. ACOV2S	51.1	0.098	0.019

SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; COV2T, Atellica IM SARS-CoV-2 Total; sCOVG, Atellica IM SARS-CoV-2 IgG; ACOV2, Elecsys Anti-SARS-CoV-2; ACOV2S, Elecsys Anti-SARS-CoV-2 S.

TOOLS

Similar articles