Journal List > Ann Lab Med > v.44(6) > 1516088442

Zhang, Zhao, Wang, Zhang, and Yue: Evaluating the Commutability of Reference Materials for α-Fetoprotein: Accurate Value Assignment With Multiple Systems and Trueness Verification

Abstract

Background

The accurate measurement of α-fetoprotein (AFP) is critical for clinical diagnosis. However, different AFP immunoassays may yield different results. Appropriate AFP reference materials (RMs) were selected and assigned accurate values for applications with external quality assessment (EQA) programs to standardize AFP measurements.

Methods

Forty individual clinical samples and six different concentrations of candidate RMs (Can-RMs, L1–L6) were prepared by the Beijing Center for Clinical Laboratories. The Can-RMs were assigned target values by performing five immunoassays, using WHO International Standard 72/225 as a calibrator, and sent to 45 clinical laboratories in Beijing for AFP measurements. The commutability of all RMs was assessed based on CLSI and the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) approaches. Analytical performance was assessed for compliance based on accuracy (total error, TE), trueness (bias), and precision (CV).

Results

The Can-RMs were commutable for all immunoassays using the CLSI approach and for 6 of 10 assay combinations using the IFCC approach. RMs diluted in WHO RM 72/225 were commutable among all assays with the CLSI approach, except for serum matrix (Autolumo vs. Roche analyzer) and diluted water matrix (Abbott vs. Roche/Mindray analyzer), whereas some inconclusive and non-commutable results were found using the IFCC approach. The average pass rates based on the TE, bias, and CV were 91%, 81%, and 95%, respectively.

Conclusions

The commutability of the RMs differed between both evaluation approaches. The Can-RMs exhibited good commutability with the CLSI approach, suggesting their suitability for use with that approach as commutable EQA materials with assigned values and for monitoring the performance of AFP measurements.

INTRODUCTION

Alpha-fetoprotein (AFP) is a glycoprotein mainly produced in the yolk sac and liver cells during the embryonic stage. With continued research interest in understanding the functions of serum AFP and continuous improvement in measurement methods, the serum AFP concentration has been found to be significantly elevated in patients with various cancers. Related findings have identified AFP as a sensitive serum marker for diagnosing primary hepatocellular carcinoma (PHC). AFP is widely used for early screening, diagnosis, monitoring disease development, guiding treatment decisions, and prognosis predictions for patients with PHC [1-5].
In human serum samples, AFP is measured using various automated systems in clinical laboratories, most commonly by performing chemiluminescent immunoassays or electrochemiluminescence immunoassays. The accurate measurement of AFP is crucial for decision-making regarding the diagnosis of relevant diseases and patient management. Metrological traceability refers to the value of laboratory results obtained with a certified reference material (RM) and reference-measurement procedure, achieved with a series of calibrations [6]. The AFP RM 72/225, designated by the WHO as a high-order RM, is used to assign values to manufacturers’ calibrators with an uninterrupted chain of traceability [7, 8]. Ensuring RM commutability in the traceability process is imperative [7]. One contributing factor to the lack of agreement is the use of non-commutable RMs as calibrators in the calibration hierarchy for clinical laboratory-measurement procedures. Commutability is defined as equivalence in the mathematical relationships between the results of different measurement procedures for a control material and representative clinical samples (CSs). Commutability of control materials is one of the most important factors affecting the implementation of external quality assessment (EQA) programs. Employing commutable materials enables the transfer of laboratory performance in such programs to CSs [9]. Ideally, an EQA program involves control materials that are commutable with patient samples and have values assigned using higher-order reference methods [10]. Providers of reference and control materials should be definitively responsible for assessing the commutability of such materials before use [11].
To standardize AFP measurements, we assessed differences and commutability with the WHO 72/225 standard diluted with six different matrices, using five different AFP immunoassays, and selected the appropriate WHO 72/225 diluent matrix to improve the comparability of AFP measurements in the different assays. We also examined the optimal approach for deciding whether prepared candidate RMs (Can-RMs) for AFP exhibit suitable commutability for use with EQA or proficiency-testing samples, which would support their use as common calibrators for measurement procedures or trueness control materials provided by manufacturers to validate calibrations [12].

MATERIALS AND METHODS

Instruments and reagents

The five automated immunoassays and reagents used in this study were as follows: Abbott Architect i2000 (Abbott Diagnostics, Abbott Park, IL, USA), Beckman DxI 800 (Beckman Coulter Inc., Brea, CA, USA), Roche Cobas E601 (Roche Diagnostics GmbH, Branchburg, NJ, USA), Mindray CL-2000i (Mindray Co., Ltd., Shenzhen, China), and Autolumo A2000 (Autobio Co., Ltd., Zhengzhou, China).
The commercial diluents were phosphate-buffered saline (PBS) (Na2HPO4, KH2PO4, NaCl, and KCl; pH 7.2–7.4), glucose-free DMEM (a14430-01; Gibco, Grand Island, NY, USA), minimal essential medium (MEM; 51200-038; Gibco), and Roswell Park Memorial Institute 1640 (RPMI) medium (r7509-500 mL; Sigma-Aldrich, St. Louis, MO, USA). A Milli-Q water system was obtained from EMD Millipore (Billerica, MA, USA). In addition, a healthy human serum pool prepared from leftover patient serum samples (collected from Beijing Chaoyang Hospital) was used as a diluent for WHO 72/225 and had a mean native AFP concentration of 3.0 µg/L.
The standard material used for AFP analysis was WHO 72/225 (60,500 µg/L), which was purchased from the National Institute for Biological Standards and Control (Hertfordshire, United Kingdom).

Preparation of Can-RMs

We collected 40 leftover patient serum samples with low, medium, and high AFP concentrations from the Laboratory Department of Beijing Chaoyang Hospital, where the AFP concentrations ranged from 5.1 to 730.9 µg/L (as measured using the Roche Cobas E601 system). Each sample (at least 2.5 mL) was evenly divided into five aliquots, which were stored at −80°C until further use. This study was approved by the Ethics Committee of Beijing Chaoyang Hospital (approval number 2023/7/11-2) and was performed in compliance with the Declaration of Helsinki. The requirement for informed consent was waived due to the retrospective nature of the study design.
Based on the CLSI C37 guidelines [13], human serum pools without hemolysis, lipemia, and icterus were prepared using serum samples from the Laboratory Department of the Beijing Chaoyang Hospital as leftover samples for AFP measurements. The samples had different AFP concentrations and were directly collected into tubes and frozen at −80°C daily. The frozen serum aliquots were thawed at room temperature, pooled, and analyzed using a Beckman DxI 800 analyzer in 1 day. These pools were thoroughly mixed, filtered through 0.22-µm membranes, aliquoted into 2 mL cryogenic vials (1 mL/vial), and stored at −80°C for later use as trueness controls or for EQA.

WHO 72/225 standards

The WHO 72/225 standard material (60,500 µg/L) was diluted in six different matrices, including PBS (P), a healthy human serum pool (S), DMEM (D), MEM (M), RPMI 1640 (RP) medium, and distilled water (DW) to theoretical standard concentrations of 726.0, 363.0, 181.5, 90.8, 36.3, and 18.2 µg/L. These samples were labeled as P1–P6, S1–S6, D1–D6, M1–M6, RP1–RP6, and DW1–DW6, respectively. Each diluted WHO 72/225 sample was divided into five equal portions. Samples from the same batch were analyzed using the following five immunoassays on the same day: Roche Cobas E601, Beckman DxI 800, Abbott Architect i2000, Mindray CL-2000i, and Autolumo A2000. All samples were analyzed in triplicate.

Commutability study

According to the CLSI EP30A guidelines [14], six concentrations of the WHO 72/225 standard diluted with six different diluent components and six levels of Can-RMs were randomly allocated among the 40 individual serum samples, and all samples were measured in triplicate with the five assays in 1 day. For commutability evaluations, the measurements were transformed to a logarithmic scale, which stabilized the SDs. The transformed data were analyzed using Deming regression, and 95% prediction intervals were calculated for each pair of assays. The commutability of the AFP RMs was evaluated based on whether the logarithmic value of the RM was within the prediction interval for CSs, measured in paired assays [8, 14, 15]. Commutability assessments were also performed according to the difference in the bias analysis based on the recommendations of the IFCC Working Group on Commutability [12, 16]. The difference between the bias for an RM and the average bias for clinical samples (BCSs) was denoted as the dRM, and the standard uncertainty of the dRM, the U(dRM), was calculated based on the distribution of the mean of bias for patient samples over the entire concentration interval [12]. The maximum |dRM| value for the RM was designated as the commutability criterion (C). The U(dRM) from the commutability sheet regarding the difference in bias between the CSs and the RMs is represented for each RM with error bars. The uncertainty consisted of two components: the uncertainty of the estimate of bias for the CSs and the uncertainty of the estimate of bias for each RM. When the uncertainty interval was within BCS±C, the RM was commutable; otherwise, it was non-commutable, and when it overlapped with the C limit, the result was inconclusive [16].

Value assignments for Can-RMs

The WHO 72/225 standard was diluted in PBS (P1–P6) and Can-RMs (L1–L6) and then measured in the same analytical sequence in triplicate on 2 consecutive days using the five assays. For each assay, WHO 72/225 was used as a common standard for traceability and transmission of the measured value. The linear-regression results for the theoretical concentration of the diluted WHO 72/225 standards and the actual measured concentrations were plotted pairwise. The assigned values of the Can-RMs were calculated after standardization with the WHO 72/225 standards. The values were assigned for Can-RMs using the average results from the five clinical analyzers.

AFP EQA survey

The Beijing Center for Clinical Laboratories (BCCL) sent trueness-verification samples (Can-RMs L2 and L3) to 45 Beijing Municipal Health Commission-affiliated laboratories for AFP measurements, and each sample was analyzed thrice on 3 consecutive days by each laboratory. Nine AFP measurements were obtained for each sample in each laboratory, and the AFP measurement results obtained from the analysis were recorded or tabulated. Precision (CV), trueness (bias), and accuracy (TE) data were used to evaluate the measurement performance, and the tolerance limit derived from the desirable biological variation (https://www.westgard.com/biodatabase1.htm) was used to evaluate the acceptability of the results [17, 18]. Within-subject and between-subject biological variations were expressed as percentages [19]. The difference between the tested and target values was determined as the bias. CVs were calculated from the nine replicate results, and the TE was calculated as the bias±2 CV [20].

Statistical analysis

The commutability of all RMs was assessed based on CLSI and IFCC approaches. Regression analyses were conducted using Deming regression, and graphs were prepared using Microsoft Excel 2010 (Microsoft, Redmond, WA, USA). Bias, CV, and TE evaluation criterion were calculated from data on biological variation (https://www.westgard.com/biodatabase1.htm) to evaluate the results of the EQA program. Intralaboratory CV was calculated from the 9 repeated results, and TE was calculated as the bias+2CV. Accordingly, the optimal analytical quality specifications of the measurements were 5.9%, 3.1% and 10.9% for AFP, respectively; the desirable analytical quality specifications of the measurements were 11.8%, 6.1%, and 21.9% for AFP, respectively; the minimal analytical quality specifications of the measurements were 17.7%, 9.2%, and 32.8% for AFP, respectively.

RESULTS

Comparability of the diluted WHO 72/225 standards in different AFP immunoassays

Diluted WHO 72/225 RMs (samples P1–P6, S1–S6, D1–D6, M1–M6, RP1–RP6, and DW1–DW6) were assessed using five immunoassays. The deviations of the measured values for the diluted WHO 72/225 samples from their standard concentrations of 726.0, 363.0, 181.5, 90.8, 36.3, and 18.2 µg/L were calculated. The results of all five assays for WHO 72/225 prepared in the six different buffer matrices are shown in Fig. 1. The measured concentrations of 72/225 in each buffer differed with each assay system. When PBS, DMEM, MEM, and RPMI were used as diluent buffers, the largest positive deviations between the measured values and the standard concentrations for WHO 72/225 were observed with the Roche and Mindray assays, which overestimated the AFP concentrations. The Abbott and Beckman systems showed negative deviations and underestimated the AFP concentrations. The Autolumo system showed a trend from a positive deviation to a negative deviation. In the serum buffer matrix, only the Mindray assay showed a positive deviation, and the Autolumo system showed a relatively significant variation. In the DW matrix, a trend toward a negative deviation was observed with decreasing AFP concentrations with the Beckman, Abbott, and Autolumo assay systems (Fig. 1).

Commutability of the RMs for AFP measurements

Fig. 2 shows the regression curves for the AFP measurements in 40 individual serum samples using the five assays, according to the CLSI method. Can-RM samples L1–L6 (developed by BCCL) were commutable across all five assays in 10 pairwise comparisons. In addition, the WHO 72/225 standard was commutable after dilution to six concentrations in all buffers, except for the serum matrix (Autolumo vs. Roche) and DW matrix (Abbott vs. Roche/Mindray). However, the Can-RM L1 and L2 results were inconclusive for the Roche vs. Autolumo comparisons, and the Can-RM L6 results were inconclusive for the Roche/Abbott/Beckman vs. Mindray comparisons, based on the IFCC method (Fig. 3). With the IFCC approach, the biological variation of the AFP data generated was 17.7% (bias), which was used as the C value. The WHO 72/225 standard diluted in different RMs showed commutability among 4 of 10 assay combinations in PBS, 5 of 10 assay combinations in serum, 2 of 10 assay combinations in RPMI, 3 of 10 assay combinations in DMEM, 4 of 10 assay combinations in MEM, and 5 of 10 assay combinations in DW. The commutability results for Can-RMs L1–L6 and the WHO standard diluted at six concentrations were determined using both the CLSI and IFCC approaches (Table 1 and Figs. 2 & 3).

Final assigned values of the BCCL AFP Can-RMs

The average assigned AFP concentrations for the BCCL Can-RMs obtained using five assay platforms were calculated based on calibration curves by interpolation from linear regression curves. Each result was expressed as the standard value ± total uncertainty. The total uncertainty of the standard value reflected the uncertainties introduced by the measurement uncertainty, homogeneity, long-term stability, and the uncertainty of international RMs. The factors contributing to the uncertainty, including those introduced by assignments with multiple systems, were comprehensively calculated for the obtained results. The final assigned concentrations for the BCCL Can-RMs L1–L6 were 12.0±0.7, 27.0±3.7, 84.2±8.1, 126.0±8.9, 232.2±21.9, and 666.4±97.3 µg/L, respectively (Table 2).

Analysis of the EQA AFP trueness program

The CV, bias, and TE evaluation criteria were determined based on the desirable level of biological variability and were 6.1%, 11.8%, and 21.9%, respectively. Using these values, the pass rates were calculated separately. When testing two levels of samples, the percentages of laboratories passing the desired bias were 74% (Can-RM L2) and 87% (Can-RM L4). In addition, 96% and 98% of the laboratories met the desired CV for Can-RM L2 and L4, respectively, and the percentages of laboratories meeting the allowable TE were 85% and 96%, respectively. For all participating laboratories, the mean bias was 1.2% (range, −17.6%–19.7%) for Can-RM L2 and −1.5% (range, −18.5%–13.1%) for Can-RM L4 (Table 3).

DISCUSSION

The purpose of an EQA program is to provide a service enabling laboratories to enhance their analytical performance to satisfactory levels and improve the quality of the results. Most routine EQA programs use materials without verified commutability and use consensus means (either from a peer group or all laboratories) as target values [10]. According to ISO17043, proficiency-test items should match in terms of the matrix, measurands, and concentrations [21]. The commutability of EQA samples with CSs is important in laboratory quality evaluations [11, 22]. In addition to using commutable RMs, it is necessary to assign values (and uncertainty) to the RMs and to define and apply clinically permissible analytical-performance specifications to substantiate the validity of laboratory measurements in clinical settings [9, 23].
We evaluated measurement differences when the WHO 72/225 standard was diluted in PBS, serum, DMEM, MEM, RPMI, or DW at six concentrations (18.15–726 µg/L). We also examined how the measured concentrations of the WHO 72/225 standard diluted in the same buffers differed with different assay systems. We calculated the deviations of the measured values at six concentrations from the standard concentrations of the diluted WHO 72/225 standards. The results revealed different deviations in the measured values with all five assays for samples in all six buffers at different concentrations. Consistent trends in terms of positive and negative deviations were observed for all five assay systems, with PBS, DMEM, MEM, or RPMI serving as the dilution buffer. Differing deviations were observed in the different assays when serum or DW was used as the matrix. These findings demonstrate how the measured AFP concentration may be affected by the diluent selected for the WHO 72/225 RM [8].
Currently, no recognized reference method exists for AFP. The commutabilities of the BCCL Can-RMs and WHO 72/225 RM across six diluent matrices were analyzed using five routine assays from different manufacturers according to the CLSI EP30A guidelines, and the difference bias was evaluated using the IFCC approach. The commutability of the tested samples differed between both approaches. The BCCL Can-RMs were commutable according to the EP30A criteria but provided inconclusive results for IFCC-based bias estimations in the Autolumo/Mindray vs. Roche and Abbott/Beckman vs. Mindray system comparisons. The WHO 72/225 RM, when diluted in PBS, DMEM, MEM, and RPMI, exhibited commutability across all six diluted concentrations for the five measurement systems with the CLSI approach. However, inconclusive or non-commutable results were obtained for some immunoassay comparisons with the IFCC approach.
Linear regression with prediction intervals (according to the CLSI approach) has been commonly used to assess the commutabilities of different RMs. This approach is based on the statistical distribution of differences in the results obtained with CSs between two assays, where the precision may vary among different pairs of assays [12]. This approach does not quantify how closely the RM agrees with the average relationship for the CS at the concentration of interest [16]. The commutability results for the RMs obtained correlate weakly with clinical data. In terms of assessing differences in bias, the standard for evaluating commutability is that the deviation/difference ± uncertainty of the RM should fall within the fixed range of the allowable deviation. The same judgment criteria can be used to evaluate all measurement procedures. However, the evaluation standard should be selected carefully and avoid being too strict for methods to pass the evaluation. Differences in the uncertainties of RMs can also affect commutability evaluations [24]. The main sources, such as the number of replicates performed with CSs and Can-RMs, position effects, and sample-specific differences (which all contribute to the uncertainty), can be specified. This approach can result in uncertainty in the commutability assessment in that the outcome may become inconclusive or indicate non-commutability [25]. Many factors can lead to non-commutability, such as the nature of the analyte and its matrix and the principles of specific assays [26]; thus, further investigation is necessary.
We assessed the commutability of the international standard material WHO 72/225 with five different AFP immunoassays (Abbott Architect i2000, Beckman DxI 800, Roche Cobas E601, Mindray CL-2000i, and Autolumo A2000). The measured mean values of the five assay systems were used as the assigned values for six concentrations of Can-RMs. Two concentrations of Can-RMs were selected as EQA samples for use with the trueness-verification program in Beijing. An average of 95% of testing laboratories met the requirement for intra-laboratory CV, and 81% and 91% met the requirements for bias and TE, respectively, indicating that more laboratories met the tolerance limit for precision (CV) than the tolerance limits for trueness (bias) and accuracy (TE). Accordingly, bias may be the main limiting factor for accurate and comparable AFP results. However, owing to the limitation of having only a few specific concentrations of samples available, it was challenging to conduct assay comparisons across the entire range of assays [27].
A major limitation of this study is that only five assays were used for AFP measurements. The second limitation is that only two concentrations were used for the EQA samples, which did not cover the entire measurement range. Future validation studies with more assays and EQA samples covering more concentrations are required. The third limitation is that the individual samples for the commutability study were stored at −80°C until use. Further research is needed to confirm whether the commutability outcomes were affected by protein-structure changes caused by freezing.
In conclusion, the commutability results for the RMs obtained with both evaluation approaches differed. Owing to differences in their intended use, both evaluation approaches involve different ways of evaluating the commutability, which may explain the observed variations in evaluation results. Specific diluents for the WHO 72/225 AFP standard are needed to ensure accurate value transmission in the traceability process. The Can-RMs exhibited good commutability and, thus, are suitable for use as commutable EQA materials with the values assigned and might improve the performance of laboratory AFP measurements. The trueness-verification results provide reliable data for promoting the improvement of the corresponding quality specifications.

ACKNOWLEDGEMENTS

None.

Notes

AUTHOR CONTRIBUTIONS

Yue Y, Zhang R, and Wang Q conceived and designed the research. Yue Y, Zhang J, and Zhao J collected and tabulated the data. Yue Y and Zhang J conducted the research. Yue Y and Zhang R analyzed and interpreted the data. Zhang J and Zhao J wrote the initial draft. Yue Y and Zhang R revised the manuscript. All authors have accepted responsibility for the entire content of this manuscript and approved its submission.

CONFLICTS OF INTEREST

None declared.

RESEARCH FUNDING

This study was supported by the Beijing Municipal Administration of Hospitals Clinical Medicine Development of Special Funding Support (grant number ZYLX202137) and Beijing Chaoyang Hospital Science and Technology Innovation Fund (grant number 22kcjjzd-7).

References

1. Gillespie JR, Uversky VN. 2000; Structure and function of alpha-fetoprotein: a biophysical overview. Biochim Biophys Acta. 1480:41–56. DOI: 10.1016/S0167-4838(00)00104-7. PMID: 11004554.
2. Wong RJ, Ahmed A, Gish RG. 2015; Elevated alpha-fetoprotein: differential diagnosis - hepatocellular carcinoma and other disorders. Clin Liver Dis. 19:309–23. DOI: 10.1016/j.cld.2015.01.005. PMID: 25921665.
3. Chang TS, Wu YC, Tung SY, Wei KL, Hsieh YY, Huang HC, et al. 2015; Alpha-fetoprotein measurement benefits hepatocellular carcinoma surveillance in patients with cirrhosis. Am J Gastroenterol. 110:836–44. quiz 845DOI: 10.1038/ajg.2015.100. PMID: 25869392.
4. Cao W, Chen Y, Han W, Yuan J, Xie W, Liu K, et al. 2021; Potentiality of α-fetoprotein (AFP) and soluble intercellular adhesion molecule-1 (sICAM-1) in prognosis prediction and immunotherapy response for patients with hepatocellular carcinoma. Bioengineered. 12:9435–51. DOI: 10.1080/21655979.2021.1990195. PMID: 34696675. PMCID: PMC8809995.
5. Hanif H, Ali MJ, Susheela AT, Khan IW, Luna-Cuadros MA, Khan MM, et al. 2022; Update on the applications and limitations of alpha-fetoprotein for hepatocellular carcinoma. World J Gastroenterol. 28:216–29. DOI: 10.3748/wjg.v28.i2.216. PMID: 35110946. PMCID: PMC8776528.
6. International Organization for Standardization. 2020. In vitro diagnostic medical devices. requirements for establishing metrological traceability of values assigned to calibrators, trueness control materials and human samples. ISO 17511:2020. https://www.iso.org/standard/69985.html. DOI: 10.3403/02874017u.
7. Vesper HW, Thienpont LM. 2009; Traceability in laboratory medicine. Clin Chem. 55:1067–75. DOI: 10.1373/clinchem.2008.107052. PMID: 19359540.
8. Yue Y, Zhang S, Xu Z, Chen X, Wang Q. 2017; Commutability of reference materials for α-fetoprotein in human serum. Arch Pathol Lab Med. 141:1421–7. DOI: 10.5858/arpa.2016-0441-OA. PMID: 28767284.
9. Braga F, Pasqualetti S, Panteghini M. 2018; The role of external quality assessment in the verification of in vitro medical diagnostics in the traceability era. Clin Biochem. 57:23–8. DOI: 10.1016/j.clinbiochem.2018.02.004. PMID: 29428441.
10. Jones GRD, Delatour V, Badrick T. 2022; Metrological traceability and clinical traceability of laboratory results - the role of commutability in external quality assurance. Clin Chem Lab Med. 60:669–74. DOI: 10.1515/cclm-2022-0038. PMID: 35179002.
11. Braga F, Panteghini M. 2019; Commutability of reference and control materials: an essential factor for assuring the quality of measurements in laboratory medicine. Clin Chem Lab Med. 57:967–73. DOI: 10.1515/cclm-2019-0154. PMID: 30903757.
12. Miller WG, Schimmel H, Rej R, Greenberg N, Ceriotti F, Burns C, et al. 2018; IFCC Working Group recommendations for assessing commutability part 1: general experimental design. Clin Chem. 64:447–54. DOI: 10.1373/clinchem.2017.277525. PMID: 29348163. PMCID: PMC5832613.
13. Danilenko U, Vesper HW, Myers GL, Clapshaw PA, Camara JE, Miller WG. 2020; An updated protocol based on CLSI document C37 for preparation of off-the-clot serum from individual units for use alone or to prepare commutable pooled serum reference materials. Clin Chem Lab Med. 58:368–74. DOI: 10.1515/cclm-2019-0732. PMID: 31665109. PMCID: PMC7153737.
14. CLSI. 2010. Characterization and qualification of commutable reference materials for laboratory medicine; approved guideline. 1st ed. Clinical and Laboratory Standards Institute;Wayne, PA: CLSI EP30-A.
15. Deprez L, Toussaint B, Zegers I, Schimmel H, Grote-Koska D, Klauke R, et al. 2018; Commutability assessment of candidate reference materials for pancreatic α-amylase. Clin Chem. 64:1193–202. DOI: 10.1373/clinchem.2018.289744. PMID: 29903873.
16. Nilsson G, Budd JR, Greenberg N, Delatour V, Rej R, Panteghini M, et al. 2018; IFCC working group recommendations for assessing commutability part 2: using the difference in bias between a reference material and clinical samples. Clin Chem. 64:455–64. DOI: 10.1373/clinchem.2017.277541. PMID: 29348165. PMCID: PMC5835923.
17. Trapé J, Botargues JM, Porta F, Ricós C, Badal JM, Salinas R, et al. 2003; Reference change value for alpha-fetoprotein and its application in early detection of hepatocellular carcinoma in patients with hepatic disease. Clin Chem. 49:1209–11. DOI: 10.1373/49.7.1209. PMID: 12816928.
18. Trapé J, Franquesa J, Sala M, Domenech M, Montesinos J, Catot S, et al. 2010; Determination of biological variation of α-fetoprotein and choriogonadotropin (β chain) in disease-free patients with testicular cancer. Clin Chem Lab Med. 48:1799–801. DOI: 10.1515/CCLM.2010.343. PMID: 20828364.
19. Coşkun A, Aarsand AK, Sandberg S, Guerra E, Locatelli M, Díaz-Garzón J, et al. 2022; Within- and between-subject biological variation data for tumor markers based on the European Biological Variation Study. Clin Chem Lab Med. 60:543–52. DOI: 10.1515/cclm-2021-0283. PMID: 33964202.
20. Korchia J, Freeman KP. 2022; Total observed error, total allowable error, and QC rules for canine serum and urine cortisol achievable with the Immulite 2000 Xpi cortisol immunoassay. J Vet Diagn Invest. 34:246–57. DOI: 10.1177/10406387221076129. PMID: 35264042. PMCID: PMC8921817.
21. Conformity assessment - General requirements for the competence of proficiency testing providers. 2023; ISO/IEC 17043:2023. https://www.iso.org/standard/80864.html.
22. Jennings I, Kitchen D, Kitchen S, Woods T, Walker I. 2019; The importance of commutability in material used for quality control purposes. Int J Lab Hematol. 41:39–45. DOI: 10.1111/ijlh.12918. PMID: 30184324.
23. Miller WG, Jones GRD, Horowitz GL, Weykamp C. 2011; Proficiency testing/external quality assessment: current challenges and future directions. Clin Chem. 57:1670–80. DOI: 10.1373/clinchem.2011.168641. PMID: 21965556.
24. Xing T, Liu J, Sun H, Gao Y, Ju Y, Liu X, et al. 2022; Commutability assessment of reference materials for homocysteine. Clin Chem Lab Med. 60:1562–9. DOI: 10.1515/cclm-2022-0388. PMID: 35977428.
25. Guo Q, Wang J, Yi X, Zeng J, Zhou W, Zhao H, et al. 2020; Commutability of reference materials for alkaline phosphatase measurements. Scand J Clin Lab Invest. 80:388–94. DOI: 10.1080/00365513.2020.1747111. PMID: 32271089.
26. Apple FS, Collinson PO. IFCC Task Force on Clinical Applications of Cardiac Biomarkers. 2012; Analytical characteristics of high-sensitivity cardiac troponin assays. Clin Chem. 58:54–61. DOI: 10.1373/clinchem.2011.165795. PMID: 21965555.
27. Zhang TJ, Pu YG, Zhou HJ, Ma R, Zhang JT, Wang DG, et al. 2018; Application of IFCC reference assay in the evaluation of five glycosylated hemoglobin detection assays. Chin J Lab Med. 12:821–6.

Fig. 1

Comparability of the results obtained when the WHO72/225 standard was diluted in six different buffer matrices and tested using five different alpha-fetoprotein immunoassays. Panels A–F show the results obtained with six different buffer matrices, including (A) phosphate-buffered saline, (B) a healthy human serum pool, (C) DMEM, (D) minimal essential medium, (E) Roswell Park Memorial Institute 1640 medium, and (F) distilled water.

alm-44-6-507-f1.tif
Fig. 2

Assessing the commutability of reference materials across five analytical systems for determining alpha-fetoprotein concentrations based on the CLSI document EP30-A method. (A) Roche assay results – Abbott assay results. (B) Roche assay – Beckman assay. (C) Roche assay – Mindray assay. (D) Roche assay – Autolumo assay. (E) Abbott assay – Beckman assay. (F) Abbott assay – Mindray assay. (G) Abbott assay – Autolumo assay. (H) Beckman assay – Autolumo assay. (I) Beckman assay – Mindray assay. (J) Autolumo assay – Mindray assay. The solid black lines are regression curves, and the dashed lines are two-tailed 95% prediction lines.

alm-44-6-507-f2.tif
Fig. 3

Assessing the commutability of reference materials (RMs) across five analytical systems for determining alpha-fetoprotein (AFP) concentrations, based on the International Federation of Clinical Chemistry and Laboratory Medicine [16] (IFCC) method. (A) Roche assay results – Abbott assay results. (B) Roche assay – Beckman assay. (C) Roche assay – Mindray assay. (D) Roche assay – Autolumo assay. (E) Abbott assay – Beckman assay. (F) Abbott assay – Mindray assay. (G) Abbott assay – Autolumo assay. (H) Beckman assay – Autolumo assay. (I) Beckman assay – Mindray assay. (J) Autolumo assay – Mindray assay. The bias of the logarithm ln (loge) of the concentrations measured with two measuring systems is shown in each case. The purple diamonds represent the six Beijing Center for Clinical Laboratories (BCCL) Can-RMs. The black circles represent the clinical samples (CSs). The error bars indicate the uncertainty of the difference in bias between each BCCL Can-RM and diluted WHO standard and the average bias for the CSs. The solid gray line is the bias-for-the-clinical sample (BCS) line, which represents the mean bias for all CSs. The red dashed lines (C lines) indicate the maximum allowable commutability-related bias (i.e., the commutability criterion [C]).

alm-44-6-507-f3.tif
Table 1

Commutability assessments for the Can-RMs and diluted WHO standard for AFP measurements, according to the CLSI EP30A and IFCC approaches

Assay combinations Can-RMs WHO-PBS WHO-Serum WHO-RPMI WHO-DMEM WHO-MEM WHO-DW
CLSI IFCC CLSI IFCC CLSI IFCC CLSI IFCC CLSI IFCC CLSI IFCC CLSI IFCC
Abbott Roche C C C C C C C C C C C C NC I
Beckman Roche C C C C C I C I C C C I C C
Mindray Roche C I C C C NC C I C I C C C C
Autolumo Roche C I C I NC NC C I C I C I C C
Beckman Abbott C C C C C C C C C C C C C I
Mindray Abbott C I C I C I C NC C I C I NC I
Autolumo Abbott C C C NC C NC C I C I C NC C I
Autolumo Beckman C C C NC C I C I C I C NC C C
Mindray Beckman C I C I C C C I C I C C C C
Mindray Autolumo C C C I C C C I C I C I C I

Abbreviations: Can-RM, candidate reference material; AFP, alpha-fetoprotein; IFCC, International Federation of Clinical Chemistry and Laboratory Medicine [16]; PBS, phosphate-buffered saline; RPMI, Roswell Park Memorial Institute 1640; MEM, minimal essential medium; DW, distilled water; C, I, and NC: commutable, inconclusive, and non-commutable results for Can-RMs L1–L6 and diluted WHO standards at six diluted concentrations, respectively.

Table 2

The assigned concentrations and uncertainties for human serum AFP concentrations in the BCCL Can-RMs

Variables Candidate reference materials
L1 L2 L3 L4 L5 L6
uchar (%) 1.2 5.9 3.9 6.8 2.8 5.8
ubb (%) 0.8 0.5 0.7 0.2 0.7 0.9
ults (%) 0.8 2.5 1.2 1.9 2.8 3.6
uWHO (%) 2.4 2.4 2.4 2.4 2.4 2.4
Relative standard uncertainty uc (%) 2.9 6.9 4.8 7.5 4.7 7.3
Relative expanded uncertainty, 2× uc (%) 5.9 13.7 9.7 14.9 9.4 14.6
Expanded uncertainty (µg/L) 0.7 3.7 8.1 18.9 21.9 97.3
Assigned value (µg/L) 12.0 27.0 84.2 126.0 232.2 666.4

Abbreviations: AFP, alpha-fetoprotein; BCCL, Beijing Center for Clinical Laboratories; Can-RM, candidate reference material; uchar, uncertainty of the measurement; ubb, uncertainty from homogeneity of the material; ults, uncertainty due to the long-term stability; uWHO, uncertainty of WHO standard materials; uc, combined standard uncertainty.

Table 3

AFP EQA pass rates of the BCCL Can-RMs according to bias, CV, and TE criteria

Instrument N* BCCL Can-RM L2 BCCL Can-RM L4
Acceptable rate, % Mean bias, %
(minimum to maximum)
Acceptable rate, % Mean bias, %
(minimum to maximum)
Bias CV TE Bias CV TE
All instruments 45 74 96 85 1.2 (−17.5 to 19.7) 87 93 96 −1.5 (−18.5 to 13.1)
Abbott Architect i2000SR/i2000/i1000SR 6 100 100 100 −3.9 (−5.2 to 0.5) 100 100 100 −5.3 (−12.6 to −0.2)
Abbott AxSym 3 100 100 100 −4.0 (−4.4 to −3.6) 100 100 100 −4.6 (−4.3 to −5.0)
Beckman Access, Access2 3 33 67 33 −0.01 (−1.5 to 18.2) 33 67 33 −4.5 (−18.4 to 13.1)
Beckman DxI600, DxI800 6 67 100 100 −8.9 (−3.1 to −14.3) 67 100 100 −10.2 (−15.1 to −3.6)
Roche Cobas E601/E602 13 77 92 85 6.8 (−17.5 to 15.4) 92 100 100 3.9 (−18.5 to 10.7)
Roche Elecsys 1010/2010, Cobas E411 6 83 100 100 3.1 (−1.9 to 12.1) 100 100 100 1.0 (−3.8 to 8.9)
Roche ES 300/600 2 100 100 100 0.9 (−8.3 to 10.1) 100 100 100 −0.5 (−10.1 to 9.2)
Siemens ADVIA Centaur CP/XP 4 25 100 25 11.9 (−3.2 to 19.7) 100 50 100 2.7 (−2.4 to 5.4)
Bioscience Peteck 96-I 1 100 100 100 −3.1 100 100 100 −5.8
SNIBE Maglumi 1 100 100 100 −11.6 100 100 100 −7.5

*The total number of participating institutions and the number of institutions utilizing the indicated analytical platform are indicated.

The difference between the tested and target values was defined as the bias. The CV was calculated from nine replicate results, and the TE was calculated as the bias±2CV. The mean bias was calculated from the mean bias results of the participating institutions utilizing each indicated platform. The evaluation criteria for CV, bias, and TE were 6.1%, 11.8%, and 21.9%, respectively.

Abbreviations: AFP, alpha-fetoprotein; EQA, external quality assessment; BCCL, Beijing Center for Clinical Laboratories; Can-RM, candidate reference material; TE, total error.

TOOLS
Similar articles