Abstract
Background
The MC-80 is a digital cell morphology analyzer developed by Mindray (China). This study evaluated the performance of the MC-80 in calculating the proportion of promonocytes and abnormal promyelocytes and compared it with manual examination.
Methods
Twenty-four peripheral blood smear samples containing promonocytes and 16 samples with abnormal promyelocytes were analyzed. The MC-80 counted 200 white blood cells from the samples and calculated the proportions of blasts and blast equivalents. Subsequently, two examiners performed the same task, and the absolute reliability between the MC-80 and the examiners, as well as between the two examiners, was evaluated using the intraclass correlation coefficient (ICC).
Results
For promonocyte samples, the ICC values obtained between the MC-80 and Examiners 1 and 2 were 0.772 and 0.780, respectively. For samples with abnormal promyelocytes, the ICC values for the MC-80 and Examiners 1 and 2 were 0.926 and 0.927, respectively. These values indicated “good” to “excellent” levels of absolute reliability by statistical interpretation. However, the MC-80 demonstrated lower levels of reliability with each examiner than between the two examiners, indicating a performance inferior to that of manual examination.
초록
배경
MC-80은 Mindray사(China)에서 개발한 자동디지털세포형태분석기이다. 이 연구는 MC-80이 전단구와 비정상 전골수구의 비율을 계산하는 능력을 평가하고 수기 검사자와 비교해보고자 하였다.
방법
전단구를 포함한 24개의 검체와 비정상 전골수구를 포함한 16개의 검체가 이용되었다. MC-80이 각각의 검체에서 200개의 백혈구를 감별계산하여 모세포와 모세포에 상응하는 세포들(blast equivalents)의 비율을 계산하였다. 이후 두 명의 검사자가 동일한 방식으로 백혈구감별계산을 실시한 후 MC-80과의 절대적 일치도(absolute reliability)를 급내상관계수(intraclass correlation coefficient)를 이용하여 분석하였다.
Differential white blood cell (WBC) count is a diagnostic test used for various diseases and is particularly significant in the diagnosis of acute leukemia. Confirming the presence of blasts in peripheral blood smears (PBS) of patients suspected of having acute leukemia is a crucial laboratory task. However, this method is time-consuming and requires experienced laboratory technicians. To overcome these challenges, numerous automated digital cell morphology analyzers have been developed [1]. One such device is the Mindray MC-80 automated digital cell morphology analyzer (Shenzhen, Guangdong, China). It functions as a digital morphology analyzer integrated into a cellular analysis line that performs complete blood count (CBC) and WBC differential. Several studies have shown that various digital morphology analyzers exhibit comparable performance to manual microscopy in distinguishing between normal cells and blasts [2-7]. However, to the best of our knowledge, no reports have been published on the capability of the MC-80 to analyze samples containing a considerable number of abnormal cells, such as promonocytes and abnormal promyelocytes, which differ from typical myeloblasts. These abnormal cells are considered blast equivalents and should be regarded as blasts [8]. Because the morphology of these cells differs from that of typical myeloblasts, even skilled experts may experience inconsistencies in interpreting their proportions. If inexperienced examiners or unvalidated morphology analyzers miss these cells, the consequences can be potentially fatal. This study assessed the degree of absolute reliability in blast equivalent proportions between the MC-80 and manual microscopy and investigated whether digital morphology analyzers, such as MC-80, could accurately diagnose acute leukemia in a clinical laboratory.
Mindray MC-80 is a newly developed automated digital cell morphology analyzer that evaluates PBS images to differentiate and classify WBCs into cell types. The equipment can be integrated with Mindray’s CBC analyzers and slide makers, such as BC-6800, to form an integrated cellular analysis line capable of detecting abnormalities not only in WBCs but also in red blood cells and platelets. This study used pre-existing PBS samples for retrospective analysis; thus, the CBC evaluation and slide preparation capacities of the integrated system were not assessed. The focus was solely on evaluating the ability of the MC-80 to analyze cell morphology.
Two examiners from the laboratory participated in manual microscopy for comparison purposes. Examiner 1 (E1) was a resident of the clinical laboratory department who had clinically interpreted over 50,000 PBS samples in the past three years. Examiner 2 (E2), a clinical laboratory technologist, had 25 years of experience in hematological cell morphology reviews. These two examiners established a consensus on cell morphology identification through regular training and discussion in the past three years.
Blood samples analyzed in this study were collected from patients who visited Yeungnam University Medical Center between January 2018 and February 2023 and underwent bone marrow examinations. Patients who tested positive for promonocytes or abnormal promyelocytes in the PBS cell morphology analysis were included in the study.
Patients in Group A had monoblasts or promonocytes in their PBS. All patients in this group tested positive for CD14 or CD64 antigen expression on bone marrow fiow cytometry. Group A included 24 patients (Table 1). Patients in Group B had abnormal promyelocytes in their PBS. All patients in this group tested positive for myeloid lineage antigen (CD13, CD33, CD117, and cMPO) expression and negative for HLA-DR expression in the bone marrow fiow cytometry analysis. Furthermore, these patients tested positive for the PML-RARA fusion gene on nested reverse-transcription polymerase chain reaction analysis of bone marrow samples. Group B included 16 patients (Table 2).
The PBS samples prepared for diagnostic evaluation were analyzed. All samples were prepared using the wedge method and stained with the Wright–Giemsa stain. The WBC differential index of the MC-80 includes blasts and abnormal promyelocytes, without distinguishing between myeloblasts, monoblasts, and promonocytes within blasts. Therefore, it was decided to consider both the blasts and abnormal promyelocytes identified by the MC-80 as leukemic cells. Manual examiners performed the same tasks to ensure uniformity.
Initially, the MC-80 was used to analyze 200 WBCs from each sample and calculate the proportion of leukemic cells. E1 and E2 sequentially analyzed 200 WBCs from the same samples and determined the proportion of leukemic cells. After all sample evaluations were completed, statistical analyses were conducted to assess the degree of absolute reliability of the proportion of leukemic cells between the examiners. Statistical analyses were performed to compare the results between the MC-80 and each manual examiner, and between the manual examiners themselves.
All statistical analyses were conducted using JASP (version 0.17.2.1; University of Amsterdam, Amsterdam, Netherlands). The intraclass correlation coefficient (ICC) was used to assess the absolute reliability of the proportion of leukemic cells between the MC-80 and each examiner. The ICC is a statistical measure used to evaluate the reliability and consistency of measurements made by different observers of the same quantity. It is often used in reliability studies, where repeated measurements are performed under varying conditions. The ICC values range from 0 to 1, where 1 indicates perfect reliability. The ICC estimates and their 95% confidence intervals (CIs) were calculated using a single rating (k=2), absolute reliability, and a two-way random-effects model. This is equivalent to the “ICC (2,1)” as defined by Shrout and Fleiss [9, 10]. The interpretation criteria used for the ICC values were based on the guidelines previously reported by Koo and Li (Table 3) [9].
For Group A samples, both the MC-80 and the two examiners were able to count 200 WBCs. The MC-80 failed to detect leukemic cells in one sample. Leukemic cells were detected in all the other samples, and the lowest percentage of leukemic cells detected in the total cell count for Groups A and B was 1.5% (Table 4).
The ICC value obtained between E1 and E2 was 0.962 (95% CI: 0.856–0.986). Therefore, based on statistical inference, the level of reliability between the two examiners was “good” to “excellent.” The ICC between MC-80 and E1 was 0.772 (95% CI: 0.306–0.915). The level of reliability was thus considered “good,” and based on statistical inference, ranged from “poor” to “excellent.” The ICC value obtained between MC-80 and E2 was 0.780 (95% CI: 0.544–0.900). Therefore, the level of reliability was considered “good,” and based on statistical inference, ranged from “moderate” to “excellent” (Table 5).
For Group B samples, both examiners counted 200 cells. However, of the six samples, MC-80 failed to count 200 cells. The WBC counts of these six samples ranged from 0 to 167. The MC-80 failed to detect WBCs in one sample. The sample (case no. B15) was excluded from final statistical analyses. Furthermore, the MC-80 failed to detect leukemic cells in three samples, including one excluded sample. Conversely, leukemic cells were detected in all samples, with the lowest value being 0.5% (Table 6).
The ICC between E1 and E2 was 0.996 (95% CI: 0.988–0.999). Therefore, based on statistical inference, the level of reliability was considered “excellent.” The ICC between MC-80 and E1 cells was 0.926 (95% CI: 0.660–0.978). Therefore, the level of reliability was considered “excellent,” and based on statistical inference, ranged from “moderate” to “excellent.” The ICC value between MC-80 and E2 was 0.927 (95% CI: 0.729 to 0.977). Therefore, the level of reliability was considered “excellent,” and based on statistical inference, ranged from “moderate” to “excellent” (Table 7).
A previous study indicated that the ability of MC-80 to detect blast cells in acute leukemia showed no significant difference compared with that of the manual method [11]. However, this study, which evaluated the ability to discriminate blast equivalents, demonstrated inferior performance compared with the reliability observed among manual examiners. The proportion of leukemic cells calculated using MC-80 in the samples containing promonocytes and abnormal promyelocytes was similar to that of the examiners. However, it had a lower level of reliability than a manual examination. This finding was particularly pronounced in samples containing promonocytes. While the examiners detected at least one blast equivalent in all 40 samples, the MC-80 failed to detect leukemic cells in four samples. These detection failures occurred in samples with a low proportion of leukemic cells or a low WBC count (<1,000/μL). These findings indicate the clear inferiority of the MC-80 for manual examination, especially in such cases. In particular, in the B15 sample, MC-80 failed to detect WBC, which appeared to be due to the low quality of the sample. However, because experienced laboratory personnel can review and validate images captured by such digital morphology analyzers, we consider the performance of MC-80 sufficient for initial screening, particularly in patients suspected of having conditions, such as acute leukemia. In cases where the automated system fails to differentiate an appropriate number of cells, setting a fiag and incorporating a system in which human inspectors verify the samples using the manual method are expected to help distinguish the cells in those samples. Thus, MC-80 can provide valuable assistance during the first-stage screening process.
This study has two limitations. First, the sample size was relatively small; only 40 samples were analyzed. Despite efforts to obtain a larger number of samples, the available samples were from before 2018 and were thus relatively old, presenting quality assurance challenges. Therefore, analyses were conducted with a limited sample size. Second, this study has significant technical limitations. The MC-80 was designed for integration with other Mindray equipment, which can provide additional useful information for cell differentiation. In this study, the analysis was conducted solely based on captured images without such additional data, creating a disparity from the actual clinical environment in which the MC-80 functions. Thus, better performance could be achieved if the samples were analyzed using the entire Mindray cellular analyzer line. Further investigations involving a larger dataset and improvements in research design may produce better outcomes that confirm the utility of the MC-80 in cell morphology analysis.
REFERENCES
1. Da Costa L. 2015; Digital image analysis of blood cells. Clin Lab Med. 35:105–22. DOI: 10.1016/j.cll.2014.10.005. PMID: 25676375.
2. Briggs C, Longair I, Slavik M, Thwaite K, Mills R, Thavaraja V, et al. 2009; Can automated blood film analysis replace the manual differential? An evaluation of the CellaVision DM96 automated image analysis system. Int J Lab Hematol. 31:48–60. DOI: 10.1111/j.1751-553X.2007.01002.x. PMID: 18177438.
3. Tabe Y, Yamamoto T, Maenou I, Nakai R, Idei M, Horii T, et al. 2015; Performance evaluation of the digital cell imaging analyzer DI-60 integrated into the fully automated Sysmex XN hematology analyzer system. Clin Chem Lab Med. 53:281–9. DOI: 10.1515/cclm-2014-0445. PMID: 25153399.
4. Kim HN, Hur M, Kim H, Kim SW, Moon HW, Yun YM. 2017; Performance of automated digital cell imaging analyzer Sysmex DI-60. Clin Chem Lab Med. 56:94–102. DOI: 10.1515/cclm-2017-0132. PMID: 28672770.
5. Kratz A, Lee SH, Zini G, Riedl JA, Hur M, Machin S, et al. 2019; Digital morphology analyzers in hematology: ICSH review and recommendations. Int J Lab Hematol. 41:437–47. DOI: 10.1111/ijlh.13042. PMID: 31046197.
6. Nam M, Yoon S, Hur M, Lee GH, Kim H, Park M, et al. 2022; Digital morphology analyzer Sysmex DI-60 vs. manual counting for white blood cell differentials in leukopenic samples: a comparative assessment of risk and turnaround time. Ann Lab Med. 42:398–405. DOI: 10.3343/alm.2022.42.4.398. PMID: 35177560. PMCID: PMC8859564.
7. Yoon S, Hur M, Park M, Kim H, Kim SW, Lee TH, et al. 2021; Performance of digital morphology analyzer Vision Pro on white blood cell differentials. Clin Chem Lab Med. 59:1099–106. DOI: 10.1515/cclm-2020-1701. PMID: 33470955.
8. Swerdlow SH, Campo E, editors. 2017. WHO Classification of Tumours of Haematopoietic and Lymphoid Tissues. Revised 4th ed. IARC;Lyon: p. 16–27. DOI: 10.53347/rid-9250.
9. Koo TK, Li MY. 2016; A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 15:155–63. DOI: 10.1016/j.jcm.2016.02.012. PMID: 27330520. PMCID: PMC4913118.
10. Shrout PE, Fleiss JL. 1979; Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 86:420–8. DOI: 10.1037/0033-2909.86.2.420. PMID: 18839484.
11. Merino A, Laguna J, Rodríguez-García M, Julian J, Casanova A, Molina A. 2024; Performance of the new MC-80 automated digital cell morphology analyser in detection of normal and abnormal blood cells: comparison with the CellaVision DM9600. Int J Lab Hematol. 46:72–82. DOI: 10.1111/ijlh.14178. PMID: 37746889.
Table 1
Table 2
Table 3
Value | Interpretation level |
---|---|
ICC < 0.5 | Poor reliability |
0.5 < ICC < 0.75 | Moderate reliability |
0.75 < ICC < 0.90 | Good reliability |
0.9 < ICC < 1.0 | Excellent reliability |
Table 4
Table 5
Comparison | Type of ICC | Point estimate | Lower 95% CI | Upper 95% CI |
---|---|---|---|---|
E1 and E2 | ICC (2,1) | 0.962 | 0.856 | 0.986 |
MC-80 and E1 | ICC (2,1) | 0.772 | 0.306 | 0.915 |
MC-80 and E2 | ICC (2,1) | 0.780 | 0.544 | 0.900 |
24 subjects and 2 examiners. ICC type as referenced by Shrout & Fleiss [10].
Table 6
Table 7
Comparison | Type of ICC | Point estimate | Lower 95% CI | Upper 95% CI |
---|---|---|---|---|
E1 and E2 | ICC (2,1) | 0.996 | 0.988 | 0.999 |
MC-80 and E1 | ICC (2,1) | 0.926 | 0.66 | 0.978 |
MC-80 and E2 | ICC (2,1) | 0.927 | 0.729 | 0.977 |
24 subjects and 2 examiners. ICC type as referenced by Shrout & Fleiss [10].