Journal List > Ann Lab Med > v.40(1) > 1130657

Chung, Hur, Yoon, Hwang, Lim, Kim, Moon, and Yun: Performance Evaluation of the QXDx BCR-ABL %IS Droplet Digital PCR Assay

Abstract

Accurate detection of BCR-ABL fusion transcripts at and below molecular response (MR) 4 (0.01% International Scale [IS]) is required for disease monitoring in patients with chronic myeloid leukemia (CML). We evaluated the analytical performance of the QXDx BCR-ABL %IS (Bio-Rad, Hercules, CA, USA) droplet digital PCR (ddPCR) assay, which is the first commercially available ddPCR-based in vitro diagnostics product. In precision analysis, the %CV was 9.3% and 3.0%, with mean values of 0.031% IS and 9.4% IS, respectively. The assay was linear in the first order, ranging from 0.032% IS to 20% IS. The manufacturer-claimed limit of blank, limit of detection, and limit of quantification were verified successfully. There was a very strong correlation between the results of the QXDx BCR-ABL %IS ddPCR assay and the ipsogen BCR-ABL1 Mbcr IS-MMR (Qiagen, Hilden, Germany) real-time quantitative PCR assay (r=0.996). In conclusion, the QXDx BCR-ABL %IS ddPCR assay can provide reliable results for CML patients.

Recent practice guidelines from the European LeukemiaNet and National Comprehensive Cancer Network for the management of patients with chronic myeloid leukemia (CML) call for the use of sensitive PCR assays, like real-time quantitative PCR (RQ-PCR) assays, for detecting BCR-ABL fusion transcripts during treatment, monitoring minimal residual disease (MRD), and identifying patients at risk of relapse [12]. It is recommended that patients are tested every three months and the results are reported in International Scale (% IS) units for standardized reporting of the molecular response (MR) [3]. However, RQ-PCR assays are limited in terms of limit of detection (LOD) and limit of quantification (LOQ) [4]. Undetectable BCR-ABL fusion transcripts using RQ-PCR assays, especially at the LOD and LOQ, affect clinical decisions and may lead to inappropriate or premature cessation of treatment [45]; adequate sensitivity levels should be achieved to detect MRD down to MR4 (0.01% IS) or MR4.5 (0.0032% IS) [6].
Droplet digital PCR (ddPCR) assay can quantify the total copy number of targets present in a sample without standards [7]. Although its underlying chemistry is similar to that of the RQ-PCR assay, the ddPCR assay has an additional step, which separates each sample into 20,000 nanoliter-sized droplets, in which the PCR occurs, improving assay precision and reproducibility [789]. The QXDx BCR-ABL %IS (Bio-Rad, Hercules, CA, USA) is the first ddPCR-based in vitro diagnostics (IVD) product with the US Food and Drug Administration clearance and European Conformity (CE) mark; however, its analytical performance has not been evaluated to date [10]. We evaluated the precision, linearity, and detection capability (limit of blank [LOB], LOD, and LOQ) of the QXDx BCR-ABL %IS ddPCR assay. We also evaluated its correlation with the CE-IVD-marked ipsogen BCR-ABL1 Mbcr IS-MMR DX (Qiagen, Hilden, Germany) RQ-PCR assay, which has been designed according to the “Europe Against Cancer” studies and is compliant with the updated international recommendations [111213].
This study was conducted between May and June 2019 at Konkuk University Medical Center (KUMC), Seoul, Korea, after obtaining exemption from approval by the Institutional Review Board of KUMC (KUH1200100). Venous whole blood (3 mL) was collected in K3 EDTA vacutainer (Greiner Bio-one, Kremsmünster, Austria), the BCR-ABL mRNA was extracted using the QIAamp RNA Blood Mini Kit (Qiagen, Valencia, CA, USA), and the mRNA samples were stored at −70℃ until use. Both the QXDx BCR-ABL %IS ddPCR assay and BCR-ABL Mbcr IS-MMR DX RQ-PCR assay were performed following the manufacturers' instructions. For the ddPCR assay, an Automated Droplet Generator (Bio-Rad), CFX96 thermal cycler (Bio-Rad), and QX200 Droplet Reader (Bio-Rad) were used; the raw data were analyzed and interpreted using the QuantaSoft software 1.7.4 (Bio-Rad).
Precision of the QXDx BCR-ABL %IS ddPCR assay was determined using a low positive control (MR3.0–5.0) and ~10% IS calibrator (MR1.0), which were included in the kit, according to the CLSI guidelines EP15-A3, using manufacturer-claimed within laboratory imprecision [14]. We replicated the assay three times in a single run, on three separate days. The %CVs were 9.3% and 3.0% with mean values of 0.031% IS and 9.4% IS, respectively; the maximal %CV of 9.3% was used to define allowable errors in the linearity assessment [14].
Linearity was determined at five levels (20, 10, 1.0, 0.1, and 0.032% IS) using a certified reference material (CRM) for BCR-ABL1, ERM-AD623f (European Commission's Joint Research Centre, EU); the CRM was diluted using CML-negative human blood samples, according to the CLSI guidelines EP06-A [15]. Quantification using the QXDx BCR-ABL %IS ddPCR assay showed a linear shape in the first order (y=0.9981x+0.0305) in log scale, ranging from 0.032% IS to 20% IS. No outliers were detected by visual examination of the scatter plot. The observed data were within the allowable error (<9.3%) with a CV of 2.6%, 1.4%, 3.9%, 7.6%, and 4.8% at the levels of 20, 10, 1.0, 0.1, and 0.032% IS, respectively.
Detection capability was estimated according to the CLSI guidelines EP17-A2 [16]. The total number of measurements was 24 each for LOB, LOD, and LOQ. To verify the LOB claim, two blank samples were measured with four replicates per sample on three separate days using one reagent lot; all 24 (100%) replicates showed the result “not detected.” To verify the LOD and LOQ claims (0.002% IS [MR4.7] for both), the lowest linearity material was diluted using CML-negative human blood samples to 0.0033% IS (MR4.5) and 0.0023% IS (MR4.6), respectively. Each sample was measured with four replicates on three separate days using one reagent lot. For LOD verification, 23 (95.8%) of the 24 replicates showed the result “analyte detected” and only one replicate was lower than the LOD (<0.002% IS). For LOQ verification, 21 (87.5%) of the 24 replicates were within the allowable error window (accuracy goal of ±15% total error at a level of 0.0028–0.0038% IS for Q1 and 0.0020–0.0027% IS for Q2; Table 1). The observed LOD and LOQ proportions (95.8% and 87.5%) all exceeded the minimum percentage of 85% (95% confidence interval) with a sample size of 24 [16], verifying the manufacturer's LOB, LOD, and LOQ claims.
The quantitative results of the QXDx BCR-ABL %IS ddPCR assay and BCR-ABL Mbcr IS-MMR DX RQ-PCR assay were compared using Passing-Bablok regression analysis according to the CLSI guidelines EP09-A3 [17]. Using a total of 20 clinical samples (ranging from 0.002% IS [MR4.7] to 20% IS [MR0.7]), the results of the two assays demonstrated a very strong correlation (r=0.996; Fig. 1).
One limitation of the QXDx BCR-ABL %IS ddPCR assay was that it was designed to detect only the e13a2 and e14a2 fusion transcripts, but not e1a2, e19a2, or other rare transcripts. Other potential limitations or disadvantages are its longer turnaround time due to the additional time required for droplet generation (60–70 min/plate) and droplet reading (120–140 min/plate) and the possibility of false positivity, although we observed no false positives [718]. Owing to the limited number of available assay kits, LOD and LOQ were verified at the levels of 0.0023% IS (MR4.64) and 0.0033% IS (MR4.49), and we could not test levels <0.002% IS (MR4.7). Further studies are needed to verify the clinical and laboratory utility of the QXDx BCR-ABL %IS ddPCR assay.
In conclusion, this is the first study to evaluate the analytical performance of the novel QXDx BCR-ABL %IS ddPCR assay. With its acceptable analytical performance, the QXDx BCR-ABL %IS ddPCR assay can be a reliable and promising tool for MRD monitoring in CML patients.

Acknowledgements

None.

Notes

Author Contributions: Chung HJ designed the study, analyzed the data, and wrote the manuscript. Hur M designed the study and finalized the manuscript. Yoon S participated in sample collection, experiments, and research protocol. Hwang K reviewed the data. Lim HS, Kim H, Moon HW, and Yun YM reviewed the manuscript. All authors read and approved the final manuscript.

Conflicts of Interest: No potential conflicts of interest relevant to this article were reported.

Research Funding: This work was supported by Konkuk University Medical Center Research Grant 2019.

References

1. Baccarani M, Castagnetti F, Gugliotta G, Rosti G. A review of the European LeukemiaNet recommendations for the management of CML. Ann Hematol. 2015; 94:S141–S147. PMID: 25814080.
2. Radich JP, Deininger M, Abboud CN, Altman JK, Berman E, Bhatia R, et al. Chronic myeloid leukemia, version 1.2019, NCCN clinical practice guidelines in oncology. J Natl Compr Canc Netw. 2018; 16:1108–1135. PMID: 30181422.
3. Branford S, Cross NC, Hochhaus A, Radich J, Saglio G, Kaeda J, et al. Rationale for the recommendations for harmonizing current methodology for detecting BCR-ABL transcripts in patients with chronic myeloid leukaemia. Leukemia. 2006; 20:1925–1930. PMID: 16990771.
4. Jennings LJ, George D, Czech J, Yu M, Joseph L. Detection and quantification of BCR-ABL1 fusion transcripts by droplet digital PCR. J Mol Diagn. 2014; 16:174–179. PMID: 24389534.
5. Kong JH, Winton EF, Heffner LT, Chen Z, Langston AA, Hill B, et al. Does the frequency of molecular monitoring after tyrosine kinase inhibitor discontinuation affect outcomes of patients with chronic myeloid leukemia? Cancer. 2017; 123:2482–2488. PMID: 28241101.
6. Cross NC, White HE, Colomer D, Ehrencrona H, Foroni L, Gottardi E, et al. Laboratory recommendations for scoring deep molecular responses following treatment for chronic myeloid leukemia. Leukemia. 2015; 29:999–1003. PMID: 25652737.
7. Alikian M, Whale AS, Akiki S, Piechocki K, Torrado C, Myint T, et al. RT-qPCR and RT-digital PCR: a comparison of different platforms for the evaluation of residual disease in chronic myeloid leukemia. Clin Chem. 2017; 63:525–531. PMID: 27979961.
8. Wang WJ, Zheng CF, Liu Z, Tan YH, Chen XH, Zhao BL, et al. Droplet digital PCR for BCR/ABL (P210) detection of chronic myeloid leukemia: a high sensitive method of the minimal residual disease and disease progression. Eur J Haematol. 2018; 101:291–296. PMID: 29691899.
9. Maier J, Lange T, Cross M, Wildenberger K, Niederwieser D, Franke GN. Optimized digital droplet PCR for BCR-ABL. J Mol Diagn. 2019; 21:27–37. PMID: 30347270.
10. Bio-Rad. QXDx BCR-ABL %IS Kit. Instructions for use. Updated on June 2019. http://www.bio-rad.com/webroot/web/pdf/lsr/literature/12006672.pdf.
11. QIAGEN ipsogen BCR-ABL1 Mbcr IS-MMR DX Kit Handbook. Updated on June 2019. https://www.qiagen.com/np/resources/resourcedetail?id=ce61c6fb-dc8d-4cae-8b37-3d3422dbd38e&lang=en.
12. Gabert J, Beillard E, van der Velden VH, Bi W, Grimwade D, Pallisgaard N, et al. Standardization and quality control studies of ‘real-time’ quantitative reverse transcriptase polymerase chain reaction of fusion gene transcripts for residual disease detection in leukemia–a Europe against cancer program. Leukemia. 2003; 17:2318–2357. PMID: 14562125.
13. Beillard E, Pallisgaard N, van der Velden VH, Bi W, Dee R, van der Schoot E, et al. Evaluation of candidate control genes for diagnosis and residual disease detection in leukemic patients using ‘real-time’ quantitative reverse-transcriptase polymerase chain reaction (RQ-PCR)–a Europe against cancer program. Leukemia. 2003; 17:2474–2486. PMID: 14562124.
14. CLSI. User verification of precision and estimation of bias; approved guideline. 3rd ed. CLSI EP15-A3. Wayne, PA: Clinical and Laboratory Standards Institute;2014.
15. CLSI. Evaluation of the linearity of quantitative measurement procedures: a statistical approach; approved guideline. CLSI EP06-A. Wayne, PA: Clinical and Laboratory Standards Institute;2003.
16. CLSI. Evaluation of detection capability for clinical laboratory measurement procedures; approved guideline. 2nd ed. CLSI EP17-A2. Wayne, PA: Clinical and Laboratory Standards Institute;2012.
17. CLSI. Measurement procedure comparison and bias estimation using patients; approved guideline. 3rd ed. CLSI EP09-A3. Wayne, PA: Clinical and Laboratory Standards Institute;2013.
18. Huggett JF, Cowen S, Foy CA. Considerations for digital PCR as an accurate molecular diagnostic tool. Clin Chem. 2015; 61:79–88. PMID: 25338683.
Fig. 1

Passing-Bablok regression of the correlation between the QXDx BCR-ABL %IS ddPCR assay and the BCR-ABL Mbcr IS-MMR DX RQ-PCR assay (N=20). Regression line with a 95% CI is shown.

Abbreviations: ddPCR, droplet digital PCR; RQ-PCR, real-time quantitative PCR; MR, molecular response; CI, confidence interval.
alm-40-72-g001
Table 1

Verification of the detection capability claims of the QXDx BCR-ABL %IS ddPCR assay

alm-40-72-i001
Manufacturer claimed value (% IS) Level of measurand (% IS) Sample Day 1 Day 2 Day 3 Observed proportion (%)*
#1 #2 #3 #4 #1 #2 #3 #4 #1 #2 #3 #4
LOB Blank Blank B1 ND ND ND ND ND ND ND ND ND ND ND ND 100.0
B2 ND ND ND ND ND ND ND ND ND ND ND ND
LOD 0.0020 0.0033 D1 AD AD AD AD AD AD AD AD AD AD AD AD 95.8
0.0023 D2 AD AD AD AD AD AD AD AD < LOD AD AD AD
LOQ 0.0020 0.0033 Q1 0.0035 0.0030 0.0037 0.0029 0.0035 0.0030 0.0037 0.0035 0.0031 0.0033 0.0037 < AEL 87.5
0.0023 Q2 0.0027 0.0023 0.0021 0.0021 0.0025 0.0022 0.0025 0.0020 < AEL > AEL 0.0021 0.0022

*Total number of measurements was 24; therefore, the acceptable observed proportion boundary was set at 85%, according to the CLSI guidelines EP17-A2 [12]. The allowable error limit was ±15% of the target value of each sample [12].

Abbreviations: ddPCR, droplet digital PCR; IS, International Scale; LOB, limit of blank; LOD, limit of detection; LOQ, limit of quantification; B, blank; D, detection; Q, quantification; ND, not detected; AD, analyte detected; AEL, allowable error limit.

TOOLS
Similar articles