Journal List > Lab Med Online > v.14(3) > 1516087643

Comparison of Mindray MC-80 Automated Digital Cell Morphology Analyzer with Manual Examination: Analysis of Abnormal Cells in Peripheral Blood Smear

Abstract

Background

The MC-80 is a digital cell morphology analyzer developed by Mindray (China). This study evaluated the performance of the MC-80 in calculating the proportion of promonocytes and abnormal promyelocytes and compared it with manual examination.

Methods

Twenty-four peripheral blood smear samples containing promonocytes and 16 samples with abnormal promyelocytes were analyzed. The MC-80 counted 200 white blood cells from the samples and calculated the proportions of blasts and blast equivalents. Subsequently, two examiners performed the same task, and the absolute reliability between the MC-80 and the examiners, as well as between the two examiners, was evaluated using the intraclass correlation coefficient (ICC).

Results

For promonocyte samples, the ICC values obtained between the MC-80 and Examiners 1 and 2 were 0.772 and 0.780, respectively. For samples with abnormal promyelocytes, the ICC values for the MC-80 and Examiners 1 and 2 were 0.926 and 0.927, respectively. These values indicated “good” to “excellent” levels of absolute reliability by statistical interpretation. However, the MC-80 demonstrated lower levels of reliability with each examiner than between the two examiners, indicating a performance inferior to that of manual examination.

Conclusions

The absolute reliabilities of the MC-80 and manual examination were inferior to the inter-examiner absolute reliability. However, with post-test validation, it is expected that the MC-80 could provide valuable assistance for the screening of blast equivalents.

초록

배경

MC-80은 Mindray사(China)에서 개발한 자동디지털세포형태분석기이다. 이 연구는 MC-80이 전단구와 비정상 전골수구의 비율을 계산하는 능력을 평가하고 수기 검사자와 비교해보고자 하였다.

방법

전단구를 포함한 24개의 검체와 비정상 전골수구를 포함한 16개의 검체가 이용되었다. MC-80이 각각의 검체에서 200개의 백혈구를 감별계산하여 모세포와 모세포에 상응하는 세포들(blast equivalents)의 비율을 계산하였다. 이후 두 명의 검사자가 동일한 방식으로 백혈구감별계산을 실시한 후 MC-80과의 절대적 일치도(absolute reliability)를 급내상관계수(intraclass correlation coefficient)를 이용하여 분석하였다.

결과

전단구를 포함한 검체들에서 MC-80과 두 명의 수기 검사자 간 얻어진 급내상관계수는 각각 0.772와 0.780이었다. 비정상 전골수구를 포함한 검체들에서 MC-80과 두 명의 수기 검사자 간 얻어진 급내상관계수는 각각 0.926과 0.927이었다. 통계적 결과 해석에 따르면 “good”에서 “excellent” 수준의 절대적 일치도를 보였으나 두 명의 수기 검사자 간의 일치도에 비하면 낮은 수준이었다.

결론

MC-80과 검사자 간의 절대적 일치도는 두 명의 수기 검사자 간의 절대적 일치도에 비해 열등했다. 그러나 검사 후 검증과정을 통한다면 MC-80이 모세포에 상응하는 세포들을 선별하는 업무에 도움을 줄 수 있을 것으로 기대된다.

INTRODUCTION

Differential white blood cell (WBC) count is a diagnostic test used for various diseases and is particularly significant in the diagnosis of acute leukemia. Confirming the presence of blasts in peripheral blood smears (PBS) of patients suspected of having acute leukemia is a crucial laboratory task. However, this method is time-consuming and requires experienced laboratory technicians. To overcome these challenges, numerous automated digital cell morphology analyzers have been developed [1]. One such device is the Mindray MC-80 automated digital cell morphology analyzer (Shenzhen, Guangdong, China). It functions as a digital morphology analyzer integrated into a cellular analysis line that performs complete blood count (CBC) and WBC differential. Several studies have shown that various digital morphology analyzers exhibit comparable performance to manual microscopy in distinguishing between normal cells and blasts [2-7]. However, to the best of our knowledge, no reports have been published on the capability of the MC-80 to analyze samples containing a considerable number of abnormal cells, such as promonocytes and abnormal promyelocytes, which differ from typical myeloblasts. These abnormal cells are considered blast equivalents and should be regarded as blasts [8]. Because the morphology of these cells differs from that of typical myeloblasts, even skilled experts may experience inconsistencies in interpreting their proportions. If inexperienced examiners or unvalidated morphology analyzers miss these cells, the consequences can be potentially fatal. This study assessed the degree of absolute reliability in blast equivalent proportions between the MC-80 and manual microscopy and investigated whether digital morphology analyzers, such as MC-80, could accurately diagnose acute leukemia in a clinical laboratory.

MATERIALS AND METHODS

1. MC-80 analyzer

Mindray MC-80 is a newly developed automated digital cell morphology analyzer that evaluates PBS images to differentiate and classify WBCs into cell types. The equipment can be integrated with Mindray’s CBC analyzers and slide makers, such as BC-6800, to form an integrated cellular analysis line capable of detecting abnormalities not only in WBCs but also in red blood cells and platelets. This study used pre-existing PBS samples for retrospective analysis; thus, the CBC evaluation and slide preparation capacities of the integrated system were not assessed. The focus was solely on evaluating the ability of the MC-80 to analyze cell morphology.
Two examiners from the laboratory participated in manual microscopy for comparison purposes. Examiner 1 (E1) was a resident of the clinical laboratory department who had clinically interpreted over 50,000 PBS samples in the past three years. Examiner 2 (E2), a clinical laboratory technologist, had 25 years of experience in hematological cell morphology reviews. These two examiners established a consensus on cell morphology identification through regular training and discussion in the past three years.

2. Sample collection and study design

Blood samples analyzed in this study were collected from patients who visited Yeungnam University Medical Center between January 2018 and February 2023 and underwent bone marrow examinations. Patients who tested positive for promonocytes or abnormal promyelocytes in the PBS cell morphology analysis were included in the study.
Patients in Group A had monoblasts or promonocytes in their PBS. All patients in this group tested positive for CD14 or CD64 antigen expression on bone marrow fiow cytometry. Group A included 24 patients (Table 1). Patients in Group B had abnormal promyelocytes in their PBS. All patients in this group tested positive for myeloid lineage antigen (CD13, CD33, CD117, and cMPO) expression and negative for HLA-DR expression in the bone marrow fiow cytometry analysis. Furthermore, these patients tested positive for the PML-RARA fusion gene on nested reverse-transcription polymerase chain reaction analysis of bone marrow samples. Group B included 16 patients (Table 2).
The PBS samples prepared for diagnostic evaluation were analyzed. All samples were prepared using the wedge method and stained with the Wright–Giemsa stain. The WBC differential index of the MC-80 includes blasts and abnormal promyelocytes, without distinguishing between myeloblasts, monoblasts, and promonocytes within blasts. Therefore, it was decided to consider both the blasts and abnormal promyelocytes identified by the MC-80 as leukemic cells. Manual examiners performed the same tasks to ensure uniformity.
Initially, the MC-80 was used to analyze 200 WBCs from each sample and calculate the proportion of leukemic cells. E1 and E2 sequentially analyzed 200 WBCs from the same samples and determined the proportion of leukemic cells. After all sample evaluations were completed, statistical analyses were conducted to assess the degree of absolute reliability of the proportion of leukemic cells between the examiners. Statistical analyses were performed to compare the results between the MC-80 and each manual examiner, and between the manual examiners themselves.

3. Statistical analyses

All statistical analyses were conducted using JASP (version 0.17.2.1; University of Amsterdam, Amsterdam, Netherlands). The intraclass correlation coefficient (ICC) was used to assess the absolute reliability of the proportion of leukemic cells between the MC-80 and each examiner. The ICC is a statistical measure used to evaluate the reliability and consistency of measurements made by different observers of the same quantity. It is often used in reliability studies, where repeated measurements are performed under varying conditions. The ICC values range from 0 to 1, where 1 indicates perfect reliability. The ICC estimates and their 95% confidence intervals (CIs) were calculated using a single rating (k=2), absolute reliability, and a two-way random-effects model. This is equivalent to the “ICC (2,1)” as defined by Shrout and Fleiss [9, 10]. The interpretation criteria used for the ICC values were based on the guidelines previously reported by Koo and Li (Table 3) [9].

RESULTS

1. Group A

For Group A samples, both the MC-80 and the two examiners were able to count 200 WBCs. The MC-80 failed to detect leukemic cells in one sample. Leukemic cells were detected in all the other samples, and the lowest percentage of leukemic cells detected in the total cell count for Groups A and B was 1.5% (Table 4).
The ICC value obtained between E1 and E2 was 0.962 (95% CI: 0.856–0.986). Therefore, based on statistical inference, the level of reliability between the two examiners was “good” to “excellent.” The ICC between MC-80 and E1 was 0.772 (95% CI: 0.306–0.915). The level of reliability was thus considered “good,” and based on statistical inference, ranged from “poor” to “excellent.” The ICC value obtained between MC-80 and E2 was 0.780 (95% CI: 0.544–0.900). Therefore, the level of reliability was considered “good,” and based on statistical inference, ranged from “moderate” to “excellent” (Table 5).

2. Group B

For Group B samples, both examiners counted 200 cells. However, of the six samples, MC-80 failed to count 200 cells. The WBC counts of these six samples ranged from 0 to 167. The MC-80 failed to detect WBCs in one sample. The sample (case no. B15) was excluded from final statistical analyses. Furthermore, the MC-80 failed to detect leukemic cells in three samples, including one excluded sample. Conversely, leukemic cells were detected in all samples, with the lowest value being 0.5% (Table 6).
The ICC between E1 and E2 was 0.996 (95% CI: 0.988–0.999). Therefore, based on statistical inference, the level of reliability was considered “excellent.” The ICC between MC-80 and E1 cells was 0.926 (95% CI: 0.660–0.978). Therefore, the level of reliability was considered “excellent,” and based on statistical inference, ranged from “moderate” to “excellent.” The ICC value between MC-80 and E2 was 0.927 (95% CI: 0.729 to 0.977). Therefore, the level of reliability was considered “excellent,” and based on statistical inference, ranged from “moderate” to “excellent” (Table 7).

DISCUSSION

A previous study indicated that the ability of MC-80 to detect blast cells in acute leukemia showed no significant difference compared with that of the manual method [11]. However, this study, which evaluated the ability to discriminate blast equivalents, demonstrated inferior performance compared with the reliability observed among manual examiners. The proportion of leukemic cells calculated using MC-80 in the samples containing promonocytes and abnormal promyelocytes was similar to that of the examiners. However, it had a lower level of reliability than a manual examination. This finding was particularly pronounced in samples containing promonocytes. While the examiners detected at least one blast equivalent in all 40 samples, the MC-80 failed to detect leukemic cells in four samples. These detection failures occurred in samples with a low proportion of leukemic cells or a low WBC count (<1,000/μL). These findings indicate the clear inferiority of the MC-80 for manual examination, especially in such cases. In particular, in the B15 sample, MC-80 failed to detect WBC, which appeared to be due to the low quality of the sample. However, because experienced laboratory personnel can review and validate images captured by such digital morphology analyzers, we consider the performance of MC-80 sufficient for initial screening, particularly in patients suspected of having conditions, such as acute leukemia. In cases where the automated system fails to differentiate an appropriate number of cells, setting a fiag and incorporating a system in which human inspectors verify the samples using the manual method are expected to help distinguish the cells in those samples. Thus, MC-80 can provide valuable assistance during the first-stage screening process.
This study has two limitations. First, the sample size was relatively small; only 40 samples were analyzed. Despite efforts to obtain a larger number of samples, the available samples were from before 2018 and were thus relatively old, presenting quality assurance challenges. Therefore, analyses were conducted with a limited sample size. Second, this study has significant technical limitations. The MC-80 was designed for integration with other Mindray equipment, which can provide additional useful information for cell differentiation. In this study, the analysis was conducted solely based on captured images without such additional data, creating a disparity from the actual clinical environment in which the MC-80 functions. Thus, better performance could be achieved if the samples were analyzed using the entire Mindray cellular analyzer line. Further investigations involving a larger dataset and improvements in research design may produce better outcomes that confirm the utility of the MC-80 in cell morphology analysis.

Notes

Conflicts of Interest

None declared.

REFERENCES

1. Da Costa L. 2015; Digital image analysis of blood cells. Clin Lab Med. 35:105–22. DOI: 10.1016/j.cll.2014.10.005. PMID: 25676375.
2. Briggs C, Longair I, Slavik M, Thwaite K, Mills R, Thavaraja V, et al. 2009; Can automated blood film analysis replace the manual differential? An evaluation of the CellaVision DM96 automated image analysis system. Int J Lab Hematol. 31:48–60. DOI: 10.1111/j.1751-553X.2007.01002.x. PMID: 18177438.
3. Tabe Y, Yamamoto T, Maenou I, Nakai R, Idei M, Horii T, et al. 2015; Performance evaluation of the digital cell imaging analyzer DI-60 integrated into the fully automated Sysmex XN hematology analyzer system. Clin Chem Lab Med. 53:281–9. DOI: 10.1515/cclm-2014-0445. PMID: 25153399.
4. Kim HN, Hur M, Kim H, Kim SW, Moon HW, Yun YM. 2017; Performance of automated digital cell imaging analyzer Sysmex DI-60. Clin Chem Lab Med. 56:94–102. DOI: 10.1515/cclm-2017-0132. PMID: 28672770.
5. Kratz A, Lee SH, Zini G, Riedl JA, Hur M, Machin S, et al. 2019; Digital morphology analyzers in hematology: ICSH review and recommendations. Int J Lab Hematol. 41:437–47. DOI: 10.1111/ijlh.13042. PMID: 31046197.
6. Nam M, Yoon S, Hur M, Lee GH, Kim H, Park M, et al. 2022; Digital morphology analyzer Sysmex DI-60 vs. manual counting for white blood cell differentials in leukopenic samples: a comparative assessment of risk and turnaround time. Ann Lab Med. 42:398–405. DOI: 10.3343/alm.2022.42.4.398. PMID: 35177560. PMCID: PMC8859564.
7. Yoon S, Hur M, Park M, Kim H, Kim SW, Lee TH, et al. 2021; Performance of digital morphology analyzer Vision Pro on white blood cell differentials. Clin Chem Lab Med. 59:1099–106. DOI: 10.1515/cclm-2020-1701. PMID: 33470955.
8. Swerdlow SH, Campo E, editors. 2017. WHO Classification of Tumours of Haematopoietic and Lymphoid Tissues. Revised 4th ed. IARC;Lyon: p. 16–27. DOI: 10.53347/rid-9250.
9. Koo TK, Li MY. 2016; A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 15:155–63. DOI: 10.1016/j.jcm.2016.02.012. PMID: 27330520. PMCID: PMC4913118.
10. Shrout PE, Fleiss JL. 1979; Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 86:420–8. DOI: 10.1037/0033-2909.86.2.420. PMID: 18839484.
11. Merino A, Laguna J, Rodríguez-García M, Julian J, Casanova A, Molina A. 2024; Performance of the new MC-80 automated digital cell morphology analyser in detection of normal and abnormal blood cells: comparison with the CellaVision DM9600. Int J Lab Hematol. 46:72–82. DOI: 10.1111/ijlh.14178. PMID: 37746889.

Table 1
Characteristics of samples in Group A
Case No. Date of bone marrow examination Sex Age CBC Blasts and their equivalent proportion in PBS (%) Bone marrow flow cytometry
Hb WBC PLT CD34 cMPO CD13 CD33 CD117 CD14 CD64 HLA-DR
A01 2018.01.10 F 77 9.1 1.7 124 2 P P P P N P NT P
A02 2018.10.26 M 78 10.3 7.6 48 24 N N P P N P NT P
A03 2018.11.12 F 69 8.7 40.2 38 7 N P P P N P NT P
A04 2018.12.07 M 72 7.5 89.7 79 35 N P P P N P NT P
A05 2019.01.21 M 48 10.7 235.0 73 57 N N P P N P NT P
A06 2019.02.25 F 83 8.3 2.51 91 11 P N P P P P NT P
A07 2019.03.04 M 46 9.2 279.8 40 81 N N P P N P P P
A08 2019.03.26 M 70 6.1 49.4 152 80 N P P P P P P P
A09 2019.08.09 F 59 8.2 12.0 89 10 N P P P N P P P
A10 2019.10.07 M 85 9.1 72.5 110 71 N P P P P P P P
A11 2020.01.16 M 54 10.8 20.2 106 1 N N P P N P P P
A12 2020.06.11 F 85 7.2 16.0 65 13 P N P P P P P P
A13 2020.08.05 F 39 7.6 58.4 55 43 P P P P P P P P
A14 2021.01.06 F 65 8.7 80.4 43 53 N N P P N P P P
A15 2021.01.14 M 79 7.2 31.2 37 24 P P P P P P P P
A16 2021.01.15 F 21 6.1 202.7 24 66 P P P P P P P P
A17 2021.02.17 F 86 7.8 225.6 24 21 N P P P P P P P
A18 2021.06.04 M 39 8.6 3.27 100 14 P N P P P P P P
A19 2021.10.18 F 62 8.2 101.0 39 41 N N N P N P P P
A20 2022.01.19 M 81 7.8 46.67 119 78 N P P P P N P P
A21 2022.01.20 M 67 8.5 63.25 24 9 P N P P P P P P
A22 2022.11.11 F 55 8.7 43.7 53 47 N P P P P P P P
A23 2023.01.27 M 30 8.9 3.9 228 21 P N N P P N P P
A24 2023.02.15 F 85 9.6 8.1 72 2 N N P P P N P P

Abbreviations: PBS, peripheral blood smear; P, positive; N, negative; NT, not tested; CBC, complete blood count; Hb, hemoglobin; WBC, white blood cell; PLT, platelets; cMPO, cytoplasmic myeloperoxidase.

Table 2
Characteristics of samples in Group B
Case No. Date of bone marrow examination Sex Age CBC Blasts and their equivalent proportion in PBS (%) Bone marrow flow cytometry PML-RARA fusion gene
Hb WBC PLT CD34 cMPO CD13 CD33 CD117 CD14 CD64 HLA-DR
B01 2018.06.21 M 46 7 15.6 60 91 P P P P P N NT N P
B02 2018.08.01 M 69 9.7 10.7 47 81 N P P P P N NT N P
B03 2018.09.28 F 57 5.4 21.0 10 83 N P P P P N NT N P
B04 2019.01.31 M 37 9.4 8.0 23 77 P P P P P N NT N P
B05 2019.03.25 F 21 10.3 1.2 51 5 N P P P P N NT N P
B06 2019.04.11 F 53 8.1 1.3 72 56 N P P P P N P N P
B07 2019.06.20 M 17 11.5 1.3 106 16 N P P P P N P N P
B08 2019.06.25 F 63 9.8 0.9 151 1 N P P P P N P N P
B09 2019.08.22 M 61 9.1 0.4 98 1 N P P P P N P N P
B10 2019.09.10 F 43 5.9 1.9 22 62 N P P P P N P N P
B11 2019.12.04 F 54 10.8 0.4 73 2 N P P P P N P N P
B12 2019.12.31 M 13 8.7 1.9 35 29 N P P P P N P N P
B13 2020.01.06 F 59 9.2 3.3 76 50 N P P P P N P N P
B14 2020.07.02 M 71 9.1 0.9 98 2 N P P P P N P N P
B15 2020.08.22 F 86 7.2 0.6 31 6 N P P P P N P N P
B16 2021.09.03 M 58 11 2.2 49 55 P P P P P N N N P

Abbreviations: PBS, peripheral blood smear; P, positive; N, negative; NT, not tested; CBC, complete blood count; Hb, hemoglobin; WBC, white blood cell; PLT, platelets; cMPO, cytoplasmic myeloperoxidase; PML-RARA, promyelocytic leukemia/retinoic acid receptor alpha.

Table 3
The ICC value interpretation criteria proposed by Koo and Li [9]
Value Interpretation level
ICC < 0.5 Poor reliability
0.5 < ICC < 0.75 Moderate reliability
0.75 < ICC < 0.90 Good reliability
0.9 < ICC < 1.0 Excellent reliability

Abbreviation: ICC, intraclass correlation coefficient.

Table 4
Calculated leukemic cell proportions for Group A
Case No. Initial PBS leukemic cell proportion (%) MC-80 (%) E1 (%) E2 (%)
A01 2.0 0.5 2.0 1.5
A02 24.0 31.0 32.5 26.5
A03 7.0 5.0 10.5 9.0
A04 35.0 30.0 61.5 70.5
A05 57.0 27.5 62.0 48.5
A06 11.0 6.0 12.5 5.0
A07 81.0 13.0 76.0 84.0
A08 80.0 78.0 78.5 79.0
A09 10.0 6.5 13.5 10.5
A10 71.0 60.5 80.5 72.0
A11 1.0 4.0 18.0 1.5
A12 13.0 19.5 18.0 15.0
A13 43.0 55.5 60.0 54.5
A14 53.0 70.5 81.5 80.0
A15 24.0 24.0 30.0 24.5
A16 66.0 56.5 59.0 66.5
A17 21.0 26.6 40.0 27.5
A18 14.0 32.0 29.0 18.0
A19 41.0 43.5 59.0 46.5
A20 78.0 71.0 86.5 79.0
A21 9.0 12.0 14.0 8.0
A22 47.0 47.5 54.0 53.0
A23 21.0 10.0 24.5 21.0
A24 2.0 0.0 11.0 2.5

Abbreviations: PBS, peripheral blood smear; E1, examiner 1; E2, examiner 2.

Table 5
Intraclass correlation coefficient value between each rater for Group A
Comparison Type of ICC Point estimate Lower 95% CI Upper 95% CI
E1 and E2 ICC (2,1) 0.962 0.856 0.986
MC-80 and E1 ICC (2,1) 0.772 0.306 0.915
MC-80 and E2 ICC (2,1) 0.780 0.544 0.900

24 subjects and 2 examiners. ICC type as referenced by Shrout & Fleiss [10].

Abbreviations: ICC, intraclass correlation coefficient; CI, confidence interval; E1, Examiner 1; E2, Examiner 2.

Table 6
Calculated leukemic cell proportions for Group B
Case No. Initial PBS leukemic cell proportion (%) Number of counted WBCs in MC-80 (%) MC-80 (%) E1 (%) E2 (%)
B01 91.0 200 76.5 87.5 90.5
B02 81.0 200 48.0 85.0 83.0
B03 83.0 200 76.0 80.5 81.5
B04 77.0 200 75.5 87.0 83.0
B05 5.0 200 4.5 6.0 4.5
B06 56.0 200 40.5 60.0 56.0
B07 16.0 200 12.9 23.0 20.5
B08 1.0 167 1.2 3.0 0.5
B09 1.0 113 3.6 3.0 4.0
B10 62.0 200 65.0 67.5 64.0
B11 2.0 116 0.0 2.0 1.5
B12 29.0 200 45.5 42.0 36.5
B13 50.0 200 37.0 48.5 53.5
B14 2.0 155 0.0 3.0 1.5
B15 6.0 NC NC 15.0 11.5
B16 55.0 158 39.2 45.5 50.0

Abbreviations: PBS, peripheral blood smear; E1, Examiner 1; E2, Examiner 2; WBC, white blood cells; NC, no count.

Table 7
Intraclass correlation coefficient value between each rater in Group B
Comparison Type of ICC Point estimate Lower 95% CI Upper 95% CI
E1 and E2 ICC (2,1) 0.996 0.988 0.999
MC-80 and E1 ICC (2,1) 0.926 0.66 0.978
MC-80 and E2 ICC (2,1) 0.927 0.729 0.977

24 subjects and 2 examiners. ICC type as referenced by Shrout & Fleiss [10].

Abbreviations: ICC, intraclass correlation coefficent; CI, confidence interval; E1, Examiner 1; E2, Examiner 2.

TOOLS
Similar articles