Abstract
Background
The identification of clinically meaningful specific immunoglobulin E (sIgE) is important for the diagnosis and management of allergic diseases. Various in vitro sIgE detection methods are available worldwide. Depending on the number of antigens that can be tested simultaneously, there are two representative methods: singleplex and multiplex. Singleplex sIgE detection is mainly provided by Thermo Fisher (ImmunoCAP) and Siemens (Immulite). This study aimed to compare the diagnostic agreement of two singleplex sIgE detection assays.
Methods
Sera from 209 Korean patients with allergic disease were used to compare the ImmunoCAP and Immulite assays with respect to the following allergens: inhalant allergens (Dermatophagoides farinae, cat and dog dander, oak, rye grass, mugwort, Alternaria, German cockroach) and food allergens (hen's egg white, cow's milk, wheat, peanut, soybean, and shrimp). Data from 902 paired comparison tests were included for comparisons. Qualitative, semi-quantitative, and quantitative comparisons were performed using statistical analyses.
Results
In qualitative comparisons, the positivity and negativity agreements ranged from 75% (wheat, shrimp) to 96% (Alternaria). Class consistency (classes 0–6) was well matched. Spearman's rank correlation coefficients for all allergens except shrimp were over 0.7. In quantitative comparisons, all allergens excluding shrimp showed >0.7 intra-class correlation coefficients.
The detection of specific IgE (sIgE) is important for the diagnosis, treatment, and prevention of allergic diseases induced by type I hypersensitivity responses. The diseases associated with IgE-mediated hypersensitivity include asthma, allergic rhinitis, atopic dermatitis, drug allergy, food allergy, and anaphylaxis. The precise identification of the clinically relevant allergen is important for allergen avoidance and appropriate immunotherapy selection. sIgE sensitization profiles can be different from allergic disease, race, and cultural difference (food or life culture). In addition, there are many differences between IgE detection methods [1].
Skin- and laboratory-based tests are available for the detection of sIgE. In vitro detection can be accomplished with singleplex and multiplex allergen-sIgE assays [2], which allow patients to continue their medications during testing [3]. Moreover, patient examination can be performed immediately after anaphylaxis without the concern of allergic reactions. Cut-off values for oral provocation and serial follow-up of sIgE titers in response to food allergens can facilitate the prediction of tolerance [4], but sIgE detection efficacy can vary based on the equipment involved and methodological approach: selection of allergen, allergen coating, and detection methods for allergen-sIgE binding [56].
Singleplex sIgE detection is mainly provided by Thermo Fisher (ImmunoCAP, Uppsala, Sweden) and Siemens (Immulite, Los Angeles, CA). ImmunoCAP is a classic method for sIgE detection because of its reliability, reproducibility, and good accordance with skin test results [78]. Immulite is a more recently developed assay that improves on some features of the ImmunoCAP approach, such as run-time and solid-phase antigen immobilization [9]. Because the systems differ methodologically [6], inter-assay validation is important for the accurate interpretation of their clinical results.
In this study, we performed inter-method comparisons of ImmunoCAP and Immulite sIgE detection systems in samples from Korean allergy patients. Because ImmunoCAP is the “gold standard” for sIgE detection and is the only singleplex test for sIgE quantitation recommended by the World Health Organization [8], we comprehensively compared the detection performances of ImmunoCAP and Immulite, using 14 inhalant and food allergens. To our knowledge, this is the first study to compare ImmunoCAP and Immulite in the Korean population using 0–100 kU/L calibrators in both assays.
A total of 209 patients were enrolled from January to December 2015. This study was performed in the Allergy and Asthma Centre at Severance Hospital, a tertiary referral hospital in Seoul, Korea. The patient inclusion criteria were as follows: 1) age between 6 and 80 years; 2) diagnosis of bronchial asthma, allergic rhinitis, atopic dermatitis, food allergy, or chronic urticaria by allergy specialists; and 3) sensitization to at least one of the 14 allergens in the sIgE detection test (skin prick test [SPT], multiple allergen simultaneous test [MAST], or ImmunoCAP test). Patients who did not agree to participate in the study were excluded. Medical charts of enrolled participants were thoroughly reviewed. This study was approved by the Institutional Review Board of the Yonsei University Health System (No. 1-2015-0044).
Approximately 3–4 mL blood samples were drawn from 209 enrolled patients using serum separation vacuum tubes (Greiner Bio-One, KremsmÜnster, Austria). The samples were immediately centrifuged, and the separated sera were aliquoted into new tubes for storage at -80℃ until later analysis. After the end of the study period, the samples were sent simultaneously to two laboratories for sIgE assays (Immulite and ImmunoCAP) without any accompanying clinical data. During sample shipment, a frozen state was maintained. As there was no central laboratory that owned both devices, we selected two separate accredited laboratories in Seoul (two Severance Hospitals located in Gangnam [Immulite] and Shinchon [ImmunoCAP]).
All study participants underwent an SPT, MAST, or sIgE detection singleplex test. The SPTs were performed using 55 commercial allergens, including negative (saline) and positive (histamine) controls. Wheal sizes were measured 15 minutes postexposure, and positive reactions were noted for wheal sizes ≥3 mm. For patients who could not discontinue antihistamine medication or had dermographism, MASTs were performed using the AdvanSure AlloScreen (LG Life Science, Seoul, Korea).
The ImmunoCAP and Immulite singleplex detection methods were used. Fourteen allergens common in Korea were chosen for comparison [10]: eight inhalant allergens (Dermatophagoides farinae; cat and dog dander; pollens of oak, rye grass and mugwort; Alternaria; and German cockroach) and six food allergens (egg white, milk, wheat, peanut, soybean, and shrimp). The detection limits of ImmunoCAP and Immulite are 0.10–100 kU/L. Both ImmunoCAP and Immulite results were reported in one of the seven classes (class 0–6). Both assays use nearly the same class scoring systems (class 1: from 0.35 to <0.7 kU/L, class 2: from 0.70 to <0.35 kU/L, class 3: from 3.50 to <17.5 kU/L, class 6: from ≥100 kU/L) except classes 4 and 5. In the ImmunoCAP system, class 4 is from 17.5 to <50 kU/L and class 5 is from 50 to <100 kU/L. Immulite defines class 4 from 17.5 to <52.5 kU/L and class 5 from 52.5 to <100 kU/L. The results of both methods were considered positive for values of 0.35 kU/L or more. Due to the limited serum sample volumes, it was not possible to perform paired tests with all 14 allergens. Instead, specific allergens were selected for each patient based on their SPT and MAST sensitization profiles.
To compare the two singleplex sIgE detection methods, we used IBM SPSS Statistics for Windows, Version 23.0 (IBM Corp., Armonk, NY) and MedCalc 11.0 (MedCalc Software, Mariakerke, Belgium) for multiple statistical tests. For qualitative comparison, total agreement ratios were calculated for each allergen as follows: total agreement ratio=(number of both tests shown positive+number of both tests shown negative)/number of total tests. Cohen's kappa analysis was also performed for agreement analysis. Second, the semi-quantitative correlations between class determinations (classes 0–6) were assessed using Spearman's rank correlation analysis and Goodman and Kruskal's gamma analysis. Spearman's correlation coefficients were classified as very high positive correlation (0.9–1.0), high positive (0.7–0.9), moderate positive (0.5–0.7), low positive (0.3–0.5), or negligible (below 0.3) correlation [11]. The kappa indices were within 0.41 and 0.92 and were classified as almost perfect (0.8–1.0), substantial (0.6–0.8), moderate (0.4–0.6), fair (0.2–0.4), or poor (below 0.2) [7]. Third, intra-class correlation (ICC) and Spearman's rank correlation analysis were used to evaluate sIgE quantitative comparisons. ICCs were classified as almost perfect (0.81–0.99), substantial (0.61–0.80), moderate (0.41–0.60), fair (0.21–0.40), or slight (0.01–0.20) agreement [12]. P<0.05 indicated statistical significance.
The median age was 27.0 years, and men comprised 57.9% of the study participants. Patients with allergic rhinitis were the most common (61.2%), followed by patients with asthma (40.2%), atopic dermatitis (31.6%), food allergy (18.2%), and chronic urticaria (13.9%). Responses to 902 combinations of allergens were compared between the two methods. The average positivity rate was 62.5% and ranged from 40.3% (milk) to 90.5% (D. farinae).
The total agreement ratios for positivity and negativity of each allergen for each test are shown in Table 1. The agreement ratios ranged from 0.75 (wheat and shrimp) to 0.96 (Alternaria). Alternaria allergen matched perfectly. Cat, dog, rye grass pollen, German cockroach, egg, and milk allergens agreed substantially. D. farinae, oak and mugwort pollens, wheat, peanut, soybean, and shrimp agreed moderately.
Class correlation analysis data using gamma indexes and Spearman's correlation coefficients are shown in Table 2. The gamma indices ranged from 0.721 to 0.956, and Spearman's correlation coefficients ranged from 0.593 to 0.882. Indices and coefficients closer to 1 indicated values in good agreement. The class correlation analysis showed a significant association between the two assays for all tested allergens. D. farinae, cat and dog danders, rye grass, mugwort, Alternaria, German cockroach, egg white, milk, wheat, peanut, and soybean showed highly positive correlations (P<0.001). Oak and shrimp showed moderately positive correlations (P<0.001).
SIgE titers were compared between the two methods using Spearman's correlation coefficient and ICC analyses. The correlation patterns are shown in Table 3 and Fig. 1. The correlation coefficients of the sIgE titers of all allergens were highly positive except for shrimp allergen, which showed a moderate correlation. D. farinae, cat and dog dander, Alternaria, German cockroach, egg white, wheat, peanut, and soybean showed almost perfect agreement. Rye grass, mugwort, milk, and shrimp showed substantial agreement. Overall, the sIgE titers of each allergen were well correlated between the two methods. In addition, we measured D. farinae sIgE titers of serially diluted serum (Fig. 2). Both ImmunoCAP and Immulite showed good linearity as a quantitation assay.
A previous study compared these systems [9] but used a 0.35–100 kUA/L calibrator, which was replaced with the 0–100 kUA/L calibrator in Korea in 2009. In addition, we also compared the Alternaria, rye grass, wheat, and soybean allergens. Moreover, a greater number of food allergy patients were enrolled in this study compared with previous research.
For the 14 allergens tested, the two assays were well-matched based on positivity, class, and sIgE titer correlations. Alternaria showed perfect agreement in positivity comparisons, high correlation with class comparisons, and almost perfect correlations with sIgE titer comparison. Except for oak and shrimp allergens, at least moderate agreements were observed in qualitative and quantitative comparisons. This study did not perform inhalant and food allergen provocation tests. Detection of sIgE does not always mean that the patient is “allergic” to the allergen. Clinically meaningful allergens should be accompanied by appropriate symptoms. Therefore, it was difficult to know exactly which assay is true in this study.
To complement this limitation, a medical chart was reviewed with regard to wheat, shrimp, and peanuts. The sIgEs of these three allergens were more frequently detected in the ImmunoCAP test than those of the other allergens (Fig. 1). In the case of wheat allergen, 13 patients were positive according to ImmunoCAP but negative based on Immulite results, although only one of the patients had a wheat food allergy according to their medical records. Regarding shrimp allergen, 12 patients tested positive when using ImmunoCAP but negative when using Immulite; medical records indicated that six of the patients had a shrimp food allergy, while the other patients were highly sensitized to house dust mite allergen, which may have cross-reactivity with shrimp [13]. Similarly, 17 patients were tested positive for peanut allergen by ImmunoCAP. Among them, eight patients were able to confirm whether they were allergic to peanuts, but none had experienced an allergic reaction to peanuts. Cross-reactivity with Fagaceae (birch) may explain this discordant finding [14]. Based on these results, further studies are needed to confirm true positive assays.
In a scatter plot of sIgE titers (Fig. 1), inhalant allergens showed better agreement than food antigens except oak. D. farinae, cat and dog dander, Alternaria, and peanut showed almost perfect correlations in ICC analysis (>0.9). Oak pollen and shrimp had fair to moderate correlations. There are national, regional, ethnical, and time differences in sensitization profiles [151617]. Mongolian (Quercus mongolica) and saw tooth (Q. acutissima) oak are the dominant oak species in Korea [18], but white oak (Q. alba) is used as the oak allergen in both ImmunoCAP and Immulite systems. Thus, detection of oak allergen reaction in the Korean patients is limited in these two assays.
Similarly, the dominant species of house dust mite differ from those in Western countries. D. farinae is the dominant species in Korea [10], but because D. farinae and D. pteronyssinus demonstrate cross-reactivity [19], they likely showed similar detection patterns in the two methods [19].
The two singleplex assays report the results using the same units but have methodological differences. The basic reaction sequence for IgE detection is identical for the two assays. However, these two assays differ in many ways: allergen binding methods, signal detection methods (amplified chemiluminescence used in Immulite, fluorescence used in the ImmunoCAP), and test running time (running time is reduced from 100 to 65 minutes in the Immulite) [6202122].
These differences can affect the interpretation of the results and cause confusion regarding patient referrals. For example, for food allergies induced by egg, milk, or peanuts, there are cut-off values for oral provocation tests during serial sIgE follow-up. Cut-offs proposed from different singleplex assays should not be applied directly for clinical decision-making. Moreover, the results from the two assays are not interchangeable, although they both present reports in kU/L [23].
This study has some limitations. First, we could not perform provocation tests, which are a gold standard method for allergy diagnosis. Second, the allergen sources and manufacturing protocols of the two assays may differ. We were unable to obtain full information about the allergen sources and processes. Third, there are subtle differences in the grading systems for classes 4 and 5. These differences may have caused discrepancies in class and titer comparisons. Fourth, we could not test all 14 allergens using both assays in the study population due to the limited serum volumes.
In conclusion, the results of both ImmunoCAP and Immulite systems showed substantial correlation with respect to sIgE detection of common inhalant and food allergens. However, the results are not interchangeable due to fundamental methodological differences between the two assays. Understanding the differences between the ImmunoCAP and Immulite systems, as revealed in this study, is important for the interpretation of allergy test findings and essential for clinical decision-making in allergy patients.
Acknowledgements
This research was supported by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI13C0010) and Siemens (1-2015-0044).
References
1. Park KH, Lee J, Lee SC, Son YW, Sim DW, Lee JH, et al. Comparison of the ImmunoCAP Assay and AdvanSure AlloScreen Advanced Multiplex Specific IgE Detection Assay. Yonsei Med J. 2017; 58:786–792. PMID: 28540992.
2. Lee JH, Park HJ, Park KH, Jeong KY, Park JW. Performance of the PROTIA (TM) Allergy-Q (R) System in the Detection of Allergen-specific IgE: A Comparison with the ImmunoCAP (R) System. Allergy Asthma Immunol Res. 2015; 7:565–572. PMID: 26333703.
3. Bousquet J, Heinzerling L, Bachert C, Papadopoulos NG, Bousquet PJ, Burney PG, et al. Practical guide to skin prick tests in allergy to aeroallergens. Allergy. 2012; 67:18–24. PMID: 22050279.
4. Celik-Bilgili S, Mehl A, Verstege A, Staden U, Nocon M, Beyer K, et al. The predictive value of specific immunoglobulin E levels in serum for the outcome of oral food challenges. Clin Exp Allergy. 2005; 35:268–273. PMID: 15784102.
5. Williams PB, Barnes JH, Szeinbach SL, Sullivan TJ. Analytic precision and accuracy of commercial immunoassays for specific IgE: Establishing a standard. J Allergy Clin Immunol. 2000; 105:1221–1230. PMID: 10856158.
6. Goikoetxea MJ, Sanz ML, Garcia BE, Mayorga C, Longo N, Gamboa PM, et al. Recommendations for the use of in vitro methods to detect specific immunoglobulin E: are they comparable? J Investig Allergol Clin Immunol. 2013; 23:448–454.
7. Lee JH, Park KH, Kim HS, Kim KW, Sohn MH, Kim CH, et al. Specific IgE measurement using AdvanSure (R) system: Comparison of detection performance with ImmunoCAP (R) system in Korean allergy patients. Clin Chim Acta. 2012; 413:914–919. PMID: 22394454.
8. Crameri R. The crux with a reliable in vitro and in vivo diagnosis of allergy. Allergy. 2013; 68:693–694. PMID: 23621640.
9. Lee YW, Sohn JH, Lee JH, Hong CS, Park JW. Allergen-specific IgE measurement with the IMMULITE 2000 system: intermethod comparison of detection performance for allergen-specific IgE antibodies from Korean allergic patients. Clin Chim Acta. 2009; 401:25–32. PMID: 19056369.
10. Park HJ, Lee JH, Park KH, Ann HW, Jin MN, Choi SY, et al. A nationwide survey of inhalant allergens sensitization and levels of indoor major allergens in Korea. Allergy Asthma Immunol Res. 2014; 6:222–227. PMID: 24843797.
11. Mukaka MM. Statistics Corner: A guide to appropriate use of correlation coefficient in medical research. Malawi Med J. 2012; 24:69–71. PMID: 23638278.
12. Sae-Jung S, Jirarattanaphochai K, Sumananont C, Wittayapairoj K, Sukhonthamarn K. Interrater reliability of the postoperative epidural fibrosis classification: a histopathologic study in the rat model. Asian Spine J. 2015; 9:587–594. PMID: 26240719.
13. Sidenius KE, Hallas TE, Poulsen LK, Mosbech H. Allergen cross-reactivity between house-dust mites and other invertebrates. Allergy. 2001; 56:723–733. PMID: 11488665.
14. Park KH, Son YW, Lee SC, Jeong K, Sim DW, Park HJ, et al. Clinical significance of component allergens in fagales pollen-sensitized peanut allergy in Korea. Allergy Asthma Immunol Res. 2016; 8:505–511. PMID: 27582401.
15. Vereda A, van Hage M, Ahlstedt S, Ibanez MD, Cuesta-Herranz J, van Odijk J, et al. Peanut allergy: clinical and immunologic differences among patients from 3 different geographic regions. J Allergy Clin Immunol. 2011; 127:603–607. PMID: 21093026.
16. Moverare R, Westritschnig K, Svensson M, Hayek B, Bende M, Pauli G, et al. Different IgE reactivity profiles in birch pollen-sensitive patients from six European populations revealed by recombinant allergens: an imprint of local sensitization. Int Arch Allergy Immunol. 2002; 128:325–335. PMID: 12218371.
17. Park HJ, Lee JH, Park KH, Kim KR, Han MJ, Choe H, et al. A six-year study on the changes in airborne pollen counts and skin positivity rates in Korea: 2008-2013. Yonsei Med J. 2016; 57:714–720. PMID: 26996572.
18. Byun JG, Lee WK, Kim M, Kwak DA, Kwak H, Park T, et al. Radial growth response of Pinus densiflora and Quercus spp. to topographic and climatic factors in South Korea. J Plant Ecol. 2013; 6:380–392.
19. Jeong KY, Park JW, Hong CS. House dust mite allergy in Korea: the most important inhalant allergen in current and future. Allergy Asthma Immunol Res. 2012; 4:313–325. PMID: 23115727.
20. Cox L, Williams B, Sicherer S, Oppenheimer J, Sher L, Hamilton R, et al. Pearls and pitfalls of allergy diagnostic testing: report from the American College of Allergy, Asthma and Immunology/American Academy of Allergy, Asthma and Immunology Specific IgE Test Task Force. Ann Allergy Asthma Immunol. 2008; 101:580–592. PMID: 19119701.
21. Li TM, Chuang T, Tse S, Hovanec-Burns D, El Shami AS. Development and validation of a third generation allergen-specific IgE assay on the continuous random access IMMULITE (R) 2000 analyzer. Ann Clin Lab Sci. 2004; 34:67–74. PMID: 15038670.
22. Hamilton RG, Williams PB, Force SITT, Asthma ACA. Human IgE antibody serology: A primer for the practicing North American allergist/immunologist. J Allergy Clin Immunol. 2010; 126:33–38. PMID: 20451984.
23. Wood RA, Segall N, Ahlstedt S, Williams PB. Accuracy of IgE antibody laboratory results. Ann Allergy Asthma Immunol. 2007; 99:34–41. PMID: 17650827.
Table 1
All P values were <0.001. P values were calculated using †Fisher's exact (D. farinae and wheat) or Pearson's chi-square tests (all others). All P values were <0.001 except D. farinae (P=0.001). P values were calculated using ‡Cohen's kappa analysis.
Abbreviations: D. farinae, Dermatophagoides farinae; CI, Confidence interval.
Table 2
Table 3
*P<0.001 (P values were calculated using; †Spearman's correlation coefficient).
Abbreviations: see Table 1.