Journal List > Lab Med Online > v.11(4) > 1147621

Comparison of Three Automated Calcitonin Immunoassays for Evaluating the Equivalence Near the Clinical Decision Point

Abstract

Background

To date, only a few studies have focused on the standardization of the calcitonin assay, despite the fact that a lack of standardization of assays can lead to discrepancy in results. Here, we analyzed the concordance in serum calcitonin test results using three different assays.

Methods

The serum calcitonin levels in 104 residual specimens collected between January and February 2020 were measured using three different systems. The Spearman’s rank correlation coefficients and the slopes and y-intercepts were assessed to derive all possible pairs of analyzers. The agreement of classification according to a clinically relevant cut-off was also evaluated using Cohen’s kappa coefficient.

Results

The correlation coefficients for Cobas e801 versus LIAISON, Atellica IM-1600 versus LIAISON, and Cobas e801 versus Atellica IM-1600 were 0.77, 0.63, and 0.95, respectively. The kappa agreement of classification at a cut-off of 10 pg/mL was 0.81, 0.81, and 0.91, respectively. However, after excluding the data points for concentrations >20 pg/mL, the correlation coefficients decreased to 0.39, 0.22, and 0.90, respectively.

Conclusions

Despite acceptable correlations for the full analytical measuring range, we observed limited correlations at low concentrations, especially around the clinical decision threshold. Therefore, continuous joint efforts by all stakeholders are essential for standardizing calcitonin assays.

초록

배경

임상 검사실에서 사용하는 여러 검사법 간에 표준화가 불충분할 경우 결과 해석의 차이로 이어질 수 있다. 이 연구에서는 세 가지 서로 다른 측정법을 사용하여 측정한 혈청 칼시토닌 농도 사이의 일치도를 분석하였다.

방법

2020년 1-2월에 수집한 104명 환자의 임상 잔여검체를 이용하여 세 장비로 혈청 칼시토닌 농도를 측정하였다. 모든 장비 간 비교에 대하여 스피어먼 상관계수, 기울기와 y-절편값을 각각 구하였다. 임상적 기준치를 기준으로 한 결과 분류의 일치도를 카파 계수를 통해 평가하였다.

결과

Cobas e801과 LIAISON, Atellica IM-1600과 LIAISON, Cobas e801과 Atellica IM-1600 사이의 스피어먼 상관계수는 각각 0.77, 0.63, 0.95였다. 칼시토닌 농도 10 pg/mL을 기준으로 한 결과 분류 간의 카파 계수는 각각 0.81, 0.81, 0.91이었다. 20 pg/mL을 초과하는 결과값을 제외하고 시행한 분석 결과 스피어먼 상관계수는 0.39, 0.22, 0.90이었다.

결론

세 장비로 측정한 칼시토닌 농도 결과값은 특히 임상적 중요 농도 근처의 낮은 농도의 검체들을 대상으로 한 분석에서 제한적인 상관관계를 보였다. 칼시토닌 검사의 표준화를 위한 관심과 노력이 필요하다.

INTRODUCTION

Calcitonin is a peptide hormone comprising of 32 amino acids with a molecular weight of 3,418 D and is mainly secreted by the C cells of the thyroid gland. In normal endocrine processes, calcitonin inhibits calcium reabsorption from the bones, thereby main6338taining bone strength [1, 2]. The plasma calcitonin concentration is relatively high in infants, and decreases rapidly until adolescence, leveling off during adulthood [3]. On average, its concentration is higher in men than in women [4, 5].
Calcitonin concentration abnormally increases in medullary thyroid cancer [6, 7]. A cut-off concentration of 10 pg/mL is most commonly used to differentiate between C-cell hyperactivity diseases (including medullary thyroid cancer) and other thyroid diseases [8-10]. In addition, a follow-up of plasma calcitonin concentration after treatment for medullary thyroid cancer is useful for monitoring recurrence and predicting patient prognosis [11, 12]. The diagnostic utility of plasma calcitonin concentration further increases when reviewed in combination with the carcinoembryonic antigen (CEA) concentration, RET protooncogene mutations, and needle aspiration biopsy findings [13, 14]. The measurement of serum calcitonin level is markedly significant as it serves as a quick and cost-effective method for diagnosing medullary thyroid cancer [6, 15-19]. Serum calcitonin concentration testing, like most tests conducted in modern clinical laboratories, is becoming increasingly advanced and automated [5, 9, 20-22].
However, standardization and harmonization of calcitonin measurements using various assays have not been achieved to date. Only few studies have evaluated the equivalence of different calcitonin assays [5, 23]. In this context, we compared the serum calcitonin levels measured using three different automated immunochemical analyzers, namely the LIAISON (Diasorin, Saluggia, Italy), Atellica IM 1600 (Siemens Healthcare Diagnostics Inc., New York, USA), and Cobas e801 (Roche Diagnostics GmbH, Mannheim, Germany), to evaluate the equivalence of the test results and determine whether the current clinical calcitonin cut-offs apply to the available calcitonin immunoassays used in clinical laboratories.

MATERIALS AND METHODS

1. Specimen collection and calcitonin measurement

From January to February 2020, 104 serum samples were referred to the laboratory of Severance Hospital for routine calcitonin measurement. Immediately after completion of the routine test, each sample was aliquoted into three tubes and stored at -70°C until the calcitonin levels were measured using the three different assays. The aliquots were thawed between 20-23°C on the same day and measured using three analyzers, namely the LIAISON, Atellica IM 1600, and Cobas e801 systems without any time interval (Table 1). This study protocol was reviewed and approved by the Institutional Review Board of Severance Hospital in Seoul, Korea (IRB No. 2019-3377-001).

2. Comparison of the methods

The methods were compared according to the Clinical and Laboratory Standards Institute (CLSI) guideline EP09c-ED3 [24]. As an established reference method was not available, we performed pairwise comparisons of the results obtained using the LIAISON, Atellica IM 1600, and Cobas e801 systems. After conducting an initial analysis with all data points, we excluded the data points for concentrations >20 pg/mL and repeated the analysis to evaluate the agreement of the measured values near the clinically significant cut-off value of 10 pg/mL.

3. Concordance of the calcitonin level classification

The calcitonin level of each subject was classified as normal or high based on a clinically meaningful cut-off of 10 pg/mL [8-10]. The agreement of the classification among the three methods, expressed as Cohen’s kappa and percentage of observed agreement, was evaluated.

4. Statistical analysis

We performed statistical analysis and presented the results as graphs using Analyse-it (v2.30, Analyse-it Software Ltd, Leeds, UK). The relationships among the calcitonin assays were evaluated by Spearman correlation analysis. The slope and y-intercepts for the results obtained using each instrument were determined by performing the Passing–Bablok regression analysis to investigate the equivalence between the pairs of instruments. Cohen’s kappa coefficient was also calculated to analyze the classification concordance.

RESULTS

1. Comparison of three different analyzers

The calcitonin values measured by the LIAISON analyzer were mainly distributed between <1.0 and >2,000 pg/mL. Fifty-six of the 104 samples (53.3%) had values exceeding the clinically meaningful cut-off (10 pg/mL). The Cobas e801 analyzer showed positive bias compared with the LIAISON analyzer, with a slope of 1.23; y-intercept, -0.94; and R, 0.77 (Fig. 1). The Atellica IM 1600 analyzer also showed a positive bias compared with the LIAISON analyzer, with a slope of 1.14; y-intercept, 1.18; and R, 0.63. Comparison of the Atellica IM 1600 analyzer with the Cobas e801 analyzer showed a slope of 1.05, y-intercept of 2.27, and R of 0.95, indicating a relatively smaller bias and a higher correlation than that of the other two pairs.

2. Correlation analysis of the data points for concentrations below 20 pg/mL

We conducted an additional analysis using only the data points for concentration <20 pg/mL to assess the concordance among the measured values near the clinically significant cut-off value of 10 pg/mL, which is commonly used for differentiating possible thyroid cancers from benign conditions. The exclusion of points for concentrations >20 pg/mL had a substantial impact on the slopes and intercepts during pairwise comparisons of the instruments. The Cobas e801 analyzer showed a negative bias compared with the LIAISON analyzer, with a slope of 0.86; y-intercept, 0.07; and R, 0.39 (Fig. 2). The Atellica IM 1600 analyzer also showed negative bias compared with the LIAISON analyzer, with a slope of 0.88; y-intercept, 2.31; and R, 0.22. Comparison of the Atellica IM 1600 analyzer with the Cobas e801 analyzer revealed a slope of 1.27; y-intercept, 1.74; and R, 0.90, indicating a much higher correlation than those noted for the other two pairs. The first two pairs under consideration showed significantly decreased correlation coefficients after excluding the data points for concentrations >20 pg/mL. We next calculated the relative differences at a critical value of 10 pg/mL between pairs of analyzers (Table 2). Compared to LIAISON’s result of 10 pg/mL, Cobas e801 showed a value of 8.63 pg/mL (95% confidence interval [CI]; 5.61 to 10.25 pg/mL) and a relative difference of -13.66% (95% CI; -43.95% to 2.49%). Similarly, Atellica IM 1600 showed a value of 11.15 pg/mL (95% CI; 8.01 to 13.43 pg/mL) and a relative difference of 11.48% (95% CI; -19.92% to 34.33%) over LIAISON. When Atellica IM 1600 was compared to Cobas e801, Atellica IM 1600 showed a value of 14.41 pg/mL (95% CI; 13.37 to 16.53 pg/mL) and the relative difference was 44.07% (95% CI; 33.67% to 65.31%) at 10 pg/mL as measured by Cobas e801.

3. Categorical concordance rate based on the cut off level of 10 pg/mL

We also assessed the effects of these systemic biases on the clinical interpretation of calcitonin levels. The calcitonin levels obtained using each instrument were categorized based on the commonly used clinical decision point, namely ≤10 pg/mL or >10 pg/mL. Using the Cobas e801 analyzer, the calcitonin levels in 30 of the 104 (28.8%) samples exceeded 10 pg/mL; the results of all 30 (100.0%) samples matched the results obtained using the LIAISON analyzer (Table 3). Moreover, 74 of the 104 (71.2%) samples showed calcitonin levels ≤10 pg/mL; the results of 65 of these 74 (87.8%) matched the results obtained using the LIAISON analyzer. In summary, for 9 samples, only the LIAISON analyzer provided calcitonin concentration measurements >10 pg/mL, and only the LIAISON analyzer did not detect calcitonin levels ≤10 pg/mL in any sample. Cohen’s kappa, used to assess classification concordance, was 0.81. Using the Atellica IM 1600 analyzer, calcitonin levels in 34 of the 104 (32.7%) samples exceeded 10 pg/mL; the results of 32 of 34 (94.1%) matched the results obtained using the LIAISON analyzer. A total of 70 of the 104 (67.3%) samples had calcitonin levels ≤10 pg/mL; the results of 63 (90.0%) of these samples mat ched the results obtained using the LIAISON analyzer. For 7 samples, only the LIAISON analyzer provided calcitonin concentration measurements >10 pg/mL; however, only 2 samples had calcitonin levels ≤10 pg/mL as detected using the LIAISON analyzer. Cohen’s kappa was 0.81. Comparison of the Atellica IM 1600 analyzer with the Cobas e801 analyzer revealed matching results of calcitonin levels >10 pg/mL for 30 of the 34 (88.2%) samples and of calcitonin levels ≤10 pg/mL for all 70 of 70 (100.0%) samples. Cohen’s kappa was 0.91.
To directly show the discordant results, the overall calcitonin concentration values <30 pg/mL obtained using the three different instruments were presented in ascending order in a single chart (Fig. 3). The three results for each sample obtained using the three different analyzers are presented on a single vertical line. The results obtained using the different analyzers are indicated by hollow markers, whereas the solid markers indicate discordance in the concentration category based on a cut-off of 10 pg/mL. The 11 samples showing discordant results include 7 samples with calcitonin concentrations >10 pg/mL measured using only the LIAISON analyzer, 2 samples with calcitonin concentrations >10 pg/mL measured using only the Atellica IM 1600 analyzer, and 2 samples with calcitonin concentration >10 pg/mL measured using both the LIAISON and Atellica IM 1600 analyzers.

DISCUSSION

Previously, the serum calcitonin levels were primarily measured using a radioimmunoassay. However, the differences in assay specificity and sensitivity, matrix-related and nonspecific serum effects, and heterogeneity in the circulating calcitonin levels contributed to contradicting results and discrepancies in the calcitonin concentrations measured using different assays. In modern clinical laboratories, several highly sensitive two-site immunometric methods, including chemiluminescence immunoassay (CLIA) are used. However, the methods for measuring calcitonin levels are not currently fully standardized [25]. Therefore, we conducted direct comparisons of the currently available instruments used for calcitonin measurement to empirically demonstrate the level of harmonization in clinical laboratories.
Initially, when all data points were included in the comparison, both the Cobas e801 and Atellica IM 1600 analyzers showed limited positive bias compared with the LIAISON analyzer, with acceptable correlation coef-cients for both comparisons. The comparison of the Atellica system with the Cobas indicated better correlation and non-significant bias. Similarly, the bias noted upon comparing the Cobas and the Atellica with the LIAISON analyzer led to clinically significant differences in the interpretation of the calcitonin levels. Based on the clinical cut-off of 10 pg/mL, of the 39 samples determined positive by LIAISON analyzer, 9 samples were determined negative by Cobas analyzer and 7 samples were determined negative by the Atellica analyzer, thereby revealing substantial discordance with the results from LIAISON system. After excluding the data points for concentrations >20 pg/mL, the discordance between the measured values around 10 pg/mL was elucidated. We observed some aberrant high concentrations when using the LIAISON analyzer compared to the other two analyzers. Comparison of the Atellica to the Cobas analyzer showed relatively high correlation, although some positive bias was observed. Based on the clinical cut-off of 10 pg/mL, the calcitonin levels of 39 of the 104 samples (37.5%) were above the threshold level when using the LIAISON analyzer, while the calcitonin levels of 9 of the 39 samples were below the threshold level when using the Cobas analyzer, revealing significant discordance with the results obtained using the LIAISON analyzer. Similarly, the calcitonin levels of 7 of the 39 samples were below the threshold level when using the Atellica analyzer, which also showed substantial discordance with the results obtained using the LIAISON system. After excluding the data points for concentrations >20 pg/mL (to elucidate the discordance between the values measured around the 10 pg/mL level), the results obtained using the Cobas e801 and Atellica IM 1600 analyzers showed weak correlations with those obtained using the LIAISON analyzer. The discordance in the calcitonin concentration measured near 10 pg/mL seemed to be the major contributor to this weak correlation. We observed some aberrantly high concentrations using the LIAISON analyzer compared to concentrations obtained for identical samples analyzed using the other analyzers. Comparison of the Atellica to the Cobas analyzer revealed higher correlation, although some positive bias was observed.
The Royal College of Pathologists of Australasia suggests an acceptable difference ±2 pg/mL calcitonin level for concentrations that are the same as, or less than 20 pg/mL and ±10% for concentrations above 20 pg/mL [26]. The allowable difference band was drawn on relative bias plots in Figs. 1 and 2. When all the data points were analyzed, Cobas e801 and Atellica IM1600 showed some positive bias over LIAISON between 20 pg/mL and 600 pg/mL, while for data points below 20 pg/mL, the two analyzers assigned a profoundly lower value for some samples than the LIAISON. The relative difference for these samples, even exceeding -100% sometimes, may have critically attributed to the weak correlation between LIAISON and the other two analyzers. For these samples, factors involved in pre-analytical or analytical phases could be considered as causes of the discrepancy. When the samples were being measured, there were no cases of recognized hemolysis, icterus, or lipidemia. Moreover, the principles of the three assays invariably resort to mouse anti-hCT (human calcitonin) antibody, albeit minor variations exist among reagent compositions. Characteristic reagent components of the three assays are indicated in Table 1. LIAISON assay included a small amount of polyclonal mouse IgG in its assay buffer to prevent the interference from heterophilic antibody. However, the Cobas and Atellica assays used a biotinylated antibody. This may result in interference from any intake of a biotin substance. All these minor differences among the assays might attribute to the discordance to some extent.
Due to the lack of a reference method for measuring the calcitonin concentration, we cannot conclude that results obtained using one of these analyzers may be closer to the actual values than those obtained using the other analyzers. However, because there were some aberrant high concentrations around 10 pg/mL when using the LIAISON analyzer in our study, we attempted to verify whether false-positive results using this analyzer were reported previously. Our results may be more informative when reviewed in combination with those reported in previous studies [5, 23]. Bieglmayer et al. [23] compared four calcitonin assays: the first version of a CLIA from LIAISON (Stillwater, MN, USA), a CLIA from Nichols Institute Diagnostics (San Juan Capistrano, CA, USA), a CLIA from Diagnostic Products Corporation (Los Angeles, CA, USA), and an immunoradiometric assay from Scantibodies (Santee, CA, USA). Comparisons of these assays revealed implausible detection of calcitonin levels in thyroidectomized patients using the LIAISON system and substantial discordance in the measured concentrations among all assays assessed, especially at low calcitonin levels. Cavalier et al. [5] compared the LIAISON Calcitonin II-gen to the cisbio h-CT (CIS bio international, Gif-sur-Yvette, France) to validate the analytical performance of the second-generation LIAISON calcitonin assay. The measurement of serum calcitonin concentrations in 250 consecutive patients showed no significant systematic bias or significant differences, as noted by the Wilcoxon test. They concluded that the specificity of the new version of the LIAISON analyzer was markedly improved, although 1 of the 14 thyroidectomized patients showed detectable calcitonin concentrations.
Currently, there is no consensus on the reference method for calcitonin measurement. To standardize the calcitonin assay, the World Health Organization (WHO) established an international reference preparation, IRR 70/234, which was replaced by the IS 89/620 standard. All three assays addressed in this study are traceable to this IS 89/620 standard. However, this standard is not commutable (that is, not proven to be equivalent for representative authentic clinical samples) for any specific assay [27]. Therefore, the possibility of significant inter-assay differences could not be disregarded, although most assays are currently calibrated to a common international reference standard. In addition, it remains uncertain whether the current clinical calcitonin cut-off applies to all available calcitonin immunoassays or if monitoring using different methods is clinically reliable when patients are transferred between healthcare facilities. There is a scarcity of studies on the concordance among various calcitonin test methods. The results of the present study indicated the differences in the measured calcitonin values for each of the three analyzers, especially at low values near the clinical cut-off. These differences are probably attributable to the use of different calibrators among the manufacturers, which is an inevitable challenge as commutable reference material is not available. Therefore, joint efforts by the expert scientific community, manufacturers, and regulatory organizations are warranted to establish a reference method and commutable reference material for improved standardization and harmonization of the calcitonin assays.
Discordant results for calcitonin levels can lead to misclassification of patients and unnecessary additional examinations or delayed diagnosis of serious disease. Due to the high sensitivity and specificity of calcitonin to medullary thyroid cancer, routine calcitonin measurements are performed in many countries, including major parts of Europe [16]. In patients with elevated basal serum calcitonin levels >10 pg/mL, pentagastrin stimulation testing is performed to distinguish among the false-positive findings and to more accurately estimate the possibility of medullary thyroid cancer [28]. Stimulated calcitonin concentrations >200 pg/mL suggest medullary thyroid cancer, which requires thyroidectomy. With respect to the impact of early diagnosis, a study on the screening of 10,864 patients reported elevated calcitonin levels in 44 patients, all confirmed to have medullary thyroid cancer based on pentagastrin-stimulated calcitonin tests. Among these patients, 59% achieved complete remission compared to 2.7% of patients with medullary thyroid cancer before the implementation of calcitonin screening [17]. A common cut-off of 10 pg/mL is conventionally used for the initial screening of C-cell hyperplastic conditions [8-10]. However, additional studies are needed to achieve a sophisticated and evidence-based consensus on new criteria considering the inter-method variability. Sex-specific cut-offs should also be considered as the reference intervals of normal calcitonin levels for women and men significantly differ [4, 5, 29]. In the current situation where there is an apparent lack of harmonization among the calcitonin measurement methods, the same instrument should be used to obtain the follow-up calcitonin concentration for a patient. Moreover, it is recommended that each laboratory use method-specific reference interval rather than universal cut-off for clinical decision.
This study had several limitations. First, we compared only three assays that use the CLIA method. Thus, further studies evaluating the equivalence among more assays using different test principles are warranted. Second, as the clinical information of patients was not available, we could not accurately identify the assay that provided clinically reliable results when there were discrepancies in the classification based on concentration.
The results of this study showed that, although three automated calcitonin immunoassays showed acceptable correlations for the full analytical measurement range, the correlation and agreement were limited at low concentration ranges, especially at the clinical decision threshold (10 pg/mL). Hence, continuous joint efforts by the expert scientific community, manufacturers, and regulatory organizations are imperative for improved standardization and harmonization of the calcitonin tests to avoid unnecessary and costly additional testing or absence of testing that may lead to a missed diagnosis of cancer. A single instrument should be consistently used when following-up a patient to avoid the effect of systemic bias among the instruments.

Notes

Conflicts of Interest

None declared.

REFERENCES

1. Copp DH, Cameron EC, Cheney BA, Davidson AG, Henze KG. 1962; Evidence for calcitonin--a new hormone from the parathyroid that lowers blood calcium. Endocrinology. 70:638–49. DOI: 10.1210/endo-70-5-638. PMID: 13881211.
crossref
2. Hirsch PF, Voelkel EF, Munson PL. 1964; Thyrocalcitonin: hypocalcemic hypophosphatemic principle of the thyroid gland. Science. 146:412–3. DOI: 10.1126/science.146.3642.412. PMID: 14186470.
crossref
3. Austin LA, Heath H 3rd. 1981; Calcitonin: physiology and pathophysiology. N Engl J Med. 304:269–78. DOI: 10.1056/NEJM198101293040505. PMID: 7003392.
4. Machens A, Hoffmann F, Sekulla C, Dralle H. 2009; Importance of gender-specific calcitonin thresholds in screening for occult sporadic medullary thyroid cancer. Endocr Relat Cancer. 16:1291–8. DOI: 10.1677/ERC-09-0136. PMID: 19726541.
crossref
5. Cavalier E, Carlisi A, Bekaert AC, Rousselle O, Chapelle JP, Delanaye P. 2011; Analytical validation of the Liaison Calcitonin_II-Gen (DiaSorin). Clin Chem Lab Med. 49:271–5. DOI: 10.1515/CCLM.2011.036. PMID: 21083442.
crossref
6. Guilloteau D, Perdrisot R, Calmettes C, Baulieu JL, Lecomte P, Kaphan G, et al. 1990; Diagnosis of medullary carcinoma of the thyroid (MCT) by calcitonin assay using monoclonal antibodies: criteria for the pentagastrin stimulation test in hereditary MCT. J Clin Endocrinol Metab. 71:1064–7. DOI: 10.1210/jcem-71-4-1064. PMID: 2401708.
crossref
7. Tobler PH, Tschopp FA, Dambacher MA, Born W, Fischer JA. 1983; Identification and characterization of calcitonin forms in plasma and urine of normal subjects and medullary carcinoma patients. J Clin Endocrinol Metab. 57:749–54. DOI: 10.1210/jcem-57-4-749. PMID: 6885964.
crossref
8. Cheung K, Roman SA, Wang TS, Walker HD, Sosa JA. 2008; Calcitonin measurement in the evaluation of thyroid nodules in the United States: a cost-effectiveness and decision analysis. J Clin Endocrinol Metab. 93:2173–80. DOI: 10.1210/jc.2007-2496. PMID: 18364376.
crossref
9. Kahaly GJ, Algeciras-Schimnich A, Davis TE, Diana T, Feldkamp J, Karger S, et al. 2017; United States and European multicenter prospective study for the analytical performance and clinical validation of a novel sensitive fully automated immunoassay for calcitonin. Clin Chem. 63:1489–96. DOI: 10.1373/clinchem.2016.270009. PMID: 28687633.
crossref
10. Allelein S, Ehlers M, Morneau C, Schwartz K, Goretzki PE, Seppel T, et al. 2018; Measurement of basal serum calcitonin for the diagnosis of medullary thyroid cancer. Horm Metab Res. 50:23–8. DOI: 10.1055/s-0043-122237. PMID: 29169190.
crossref
11. Rink T, Truong PN, Schroth HJ, Diener J, Zimny M, Grünwald F. 2009; Calculation and validation of a plasma calcitonin limit for early detection of medullary thyroid carcinoma in nodular thyroid disease. Thyroid. 19:327–32. DOI: 10.1089/thy.2008.0102. PMID: 19355822.
crossref
12. Engelbach M, Gorges R, Forst T, Pfutzner A, Dawood R, Heerdt S, et al. 2000; Improved diagnostic methods in the follow-up of medullary thyroid carcinoma by highly specific calcitonin measurements. J Clin Endocrinol Metab. 85:1890–4. DOI: 10.1210/jcem.85.5.6601. PMID: 10843170.
crossref
13. Wion-Barbot N, Schuffenecker I, Niccoli P, Conte-Devolx B, Lecomte P, Houdent C, et al. 1997; Results of the calcitonin stimulation test in normal volunteers compared with genetically unaffected members of MEN 2A and familial medullary thyroid carcinoma families. Ann Endocrinol (Paris). 58:302–8. PMID: 9436479.
14. Conte-Devolx B, Schuffenecker I, Niccoli P, Maes B, Boneu A, Barbot N, et al. 1997; Multiple endocrine neoplasia type 2: management of patients and subjects at risk. French Study Group on Calcitonin-Secreting Tumors (GETC). Horm Res. 47:221–6. DOI: 10.1159/000185467. PMID: 9167955.
15. Vierhapper H, Niederle B, Bieglmayer C, Kaserer K, Baumgartner-Parzer S. 2005; Early diagnosis and curative therapy of medullary thyroid carcinoma by routine measurement of serum calcitonin in patients with thyroid disorders. Thyroid. 15:1267–72. DOI: 10.1089/thy.2005.15.1267. PMID: 16356091.
crossref
16. Karges W, Dralle H, Raue F, Mann K, Reiners C, Grussendorf M, et al. 2004; Calcitonin measurement to detect medullary thyroid carcinoma in nodular goiter: German evidence-based consensus recommendation. Exp Clin Endocrinol Diabetes. 112:52–8. DOI: 10.1055/s-2004-815727. PMID: 14758572.
crossref
17. Elisei R, Bottici V, Luchetti F, Di Coscio G, Romei C, Grasso L, et al. 2004; Impact of routine measurement of serum calcitonin on the diagnosis and outcome of medullary thyroid cancer: experience in 10,864 patients with nodular thyroid disorders. J Clin Endocrinol Metab. 89:163–8. DOI: 10.1210/jc.2003-030550. PMID: 14715844.
crossref
18. Ozgen AG, Hamulu F, Bayraktar F, Yilmaz C, Tuzun M, Yetkin E, et al. 1999; Evaluation of routine basal serum calcitonin measurement for early diagnosis of medullary thyroid carcinoma in seven hundred seventy-three patients with nodular goiter. Thyroid. 9:579–82. DOI: 10.1089/thy.1999.9.579. PMID: 10411120.
crossref
19. Cavalier E, Carlisi A, Chapelle JP, Delanaye P. 2008; Analytical quality of calcitonin determination and its effect on the adequacy of screening for medullary carcinoma of the thyroid. Clin Chem. 54:929–30. DOI: 10.1373/clinchem.2007.100636. PMID: 18443183.
crossref
20. Schiettecatte J, Strasser O, Anckaert E, Smitz J. 2016; Performance evaluation of an automated electrochemiluminescent calcitonin (CT) immunoassay in diagnosis of medullary thyroid carcinoma. Clin Biochem. 49:929–31. DOI: 10.1016/j.clinbiochem.2016.05.006. PMID: 27182955.
crossref
21. Motté P, Vauzelle P, Gardet P, Ghillani P, Caillou B, Parmentier C, et al. 1988; Construction and clinical validation of a sensitive and specific assay for serum mature calcitonin using monoclonal anti-peptide antibodies. Clin Chim Acta. 174:35–54. DOI: 10.1016/0009-8981(88)90365-8. PMID: 2454766.
crossref
22. Leclerc L, Vantyghem MC, Fourrier F, Proye C, Wemeau JL. d'Herbomez M. 2001; Clinical evaluation of a new sensitive calcitonin assay: study of specificity. Clin Chim Acta. 311:149–55. DOI: 10.1016/S0009-8981(01)00582-4. PMID: 11566174.
23. Bieglmayer C, Vierhapper H, Dudczak R, Niederle B. 2007; Measurement of calcitonin by immunoassay analyzers. Clin Chem Lab Med. 45:662–6. DOI: 10.1515/CCLM.2007.124. PMID: 17484631.
crossref
24. Clinical and Laboratory Standards Institute. 2018. Measurement procedure comparison and bias estimation using patient samples; Approved guideline-Third edition. EP09c-ED3. Clinical and Laboratory Standards Institute;EP09c-ED3. Wayne, PA:
25. McPherson RA, Pincus MR, editors. 2017. Henry's clinical diagnosis and management by laboratory methods. 23rd ed. Elsevier;St. Louis, MO:
26. The Royal College of Pathologists of Australasia Quality Assurance Programs. Allowable limits of performance. (Programs, Analytes and Allowable Limits of Performance). http://www.rcpaqap.com.au/docs/2014/chempath/ALP.pdf. Updated on Aug 2014.
27. National Institute for Biological Standards and Control. WHO International Standard, Calcitonin, Human, NIBSC code: 89/620, Instructions for use, (Version 5.0, Dated 28/03/2013). https://www.nibsc.org/documents/ifu/89-620.pdf. Last accessed on Feb 2021.
28. Herrmann BL, Schmid KW, Goerges R, Kemen M, Mann K. 2010; Calcitonin screening and pentagastrin testing: predictive value for the diagnosis of medullary carcinoma in nodular thyroid disease. Eur J Endocrinol. 162:1141–5. DOI: 10.1530/EJE-10-0111. PMID: 20332126.
crossref
29. Ramachandran R, Benfield P, Dhillo WS, White S, Chapman R, Meeran K, et al. 2009; Need for revision of diagnostic limits for medullary thyroid carcinoma with a new immunochemiluminometric calcitonin assay. Clin Chem. 55:2225–6. DOI: 10.1373/clinchem.2009.129361. PMID: 19833839.
crossref

Fig. 1
Passing–Bablok regression and bias plots for all data points. Results obtained using the Cobas e801 analyzer compared to those obtained using the LIAISON analyzer (upper left), results obtained using the Atellica IM1600 analyzer compared to those obtained using the LIAISON analyzer (middle left), and results obtained using the Atellica IM1600 analyzer compared with those obtained using the Cobas e801 analyzer (lower left) were plotted with the Passing–Bablok regression and identity lines. P-values for linearity test are also indicated. The corresponding relative bias plots are displayed on the right side.
lmo-11-4-235-f1.tif
Fig. 2
Passing–Bablok regression and bias plots excluding the data points for concentrations >20 pg/mL. Results obtained using the Cobas e801 analyzer compared to those obtained using the LIAISON analyzer (upper left), results obtained using the Atellica IM1600 compared to those using the LIAISON analyzer (middle left), and results obtained using the Atellica IM1600 analyzer compared to those obtained using the Cobas e801 analyzer (lower left) were plotted with the Passing–Bablok regression and identity lines. Only data points for concentrations <20 pg/mL were included in the regression analysis. P-values for linearity test are also indicated. The corresponding relative bias plots are displayed on the right side.
lmo-11-4-235-f2.tif
Fig. 3
Scatter plot showing calcitonin concentrations measured using all three analyzers. Data points for the calcitonin concentrations <50 pg/mL measured using the three analyzers were plotted in the order of increasing average concentrations. The discordance between the interpretive categories (concentration ≤10 pg/mL and concentration >10 pg/mL) is indicated by solid markers and all other results are indicated by hollow markers.
lmo-11-4-235-f3.tif
Table 1
Specifications of the calcitonin assays
Manufacturer Analyzer Reagent Characteristic reagent component Assay principle AMR (pg/mL) Traceability
Diasorin LIAISON® Calcitonin II-Gen Assay Polyclonal Mouse IgG CLIA 1–2,000 WHO
Reference Standard 89/620
Siemens Healthcare Diagnostics Atellica® IM 1600 Atellica IM Calcitonin Assay Biotinylated antibody CLIA 1.89–2,000 WHO
Reference Standard 89/620
Roche Diagnostics Cobas e801 Elecsys Calcitonin Assay Biotinylated antibody ECLIA 0.5–2,000 WHO
Reference Standard 89/620

Abbreviations: AMR, analytical measurement range; CLIA, chemiluminescence immunoassay; ECLIA, electrochemiluminescence immunoassay.

Table 2
Predicted calcitonin concentrations and relative differences at 10 pg/mL calculated by the Passing–Bablok regression analysis with data points for concentrations <20 pg/mL
Compared methods (Y to X) N Predicted Y (95% CI) Relative difference, % (95% CI)
Cobas e801 modular analyzer to LIAISON analyzer 76 8.63 (5.61 to 10.25) -13.66 (-43.95 to 2.49)
Atellica IM 1600 analyzer to LIAISON analyzer 76 11.15 (8.01 to 13.43) 11.48 (-19.92 to 34.33)
Atellica IM 1600 analyzer to Cobas e801 modular analyzer 76 14.41 (13.37 to 16.53) 44.07 (33.67 to 65.31)

Abbreviation: CI, confidence interval.

Table 3
Agreement of calcitonin concentration classification based on the clinical decision point
A. Cobas e801 system versus LIAISON system
LIAISON, pg/mL
≤10 >10
Cobas, pg/mL ≤10 65 9
>10 0 30
B. Atellica IM-1600 system versus LIAISON system
LIAISON, pg/mL
≤10 >10
Atellica, pg/mL ≤10 63 7
>10 2 32
C. Atellica IM-1600 system versus Cobas e801 system
LIAISON, pg/mL
≤10 >10
Atellica, pg/mL ≤10 70 0
>10 4 30
TOOLS
Similar articles