Journal List > Ann Lab Med > v.37(6) > 1091551

Huh, Kim, Kwon, Yun, Lee, Ki, Lee, and Kim: Performance Evaluation of the PowerChek MERS (upE & ORF1a) Real-Time PCR Kit for the Detection of Middle East Respiratory Syndrome Coronavirus RNA

Abstract

Background

Molecular detection of Middle East respiratory syndrome coronavirus (MERS-CoV) using real-time reverse transcription (rRT)-PCR assays is the method of choice for diagnosis of MERS. We evaluated the performance of the PowerChek MERS (upE & ORF1a) real-time PCR Kit (PowerChek MERS assay; Kogene Biotech, Korea) a one-step rRT-PCR assay for the qualitative detection of MERS-CoV.

Methods

We evaluated PowerChek MERS assay performance in comparison with nested RT-PCR and sequencing of the RNA-dependent RNA polymerase (RdRp) and N genes. To evaluate diagnostic sensitivity and specificity, 100 clinical specimens (50 positive and 50 negative for MERS-CoV) were simultaneously tested by using the PowerChek MERS and sequencing assays. Assay performance, including limit of detection and precision, was evaluated in vitro by using MERS-CoV RNA transcripts. Analytical specificity was evaluated with a diverse collection of 16 respiratory virus–positive clinical specimens and 14 respiratory bacterial isolates.

Results

The 95% limits of detection of the PowerChek MERS assay for the upE and the open rading frame (ORF)1a were 16.2 copies/µL and 8.2 copies/µL, respectively. No cross-reactivity was observed. The diagnostic sensitivity and specificity of the PowerChek MERS assay were both 100% (95% confidence interval, 91.1–100%).

Conclusions

The PowerChek MERS assay is a straightforward and accurate assay for detecting MERS-CoV RNA. The assay will be a useful tool for the rapid diagnosis of MERS and could prove especially important for MERS outbreak control.

INTRODUCTION

For effective control of potential outbreaks of Middle East respiratory syndrome (MERS), highly sensitive and specific laboratory diagnostic tests are needed. Nucleic acid amplification assays are the method most widely used to provide laboratory confirmation of MERS [1]. MERS cases are routinely confirmed based on the detection of unique MERS coronavirus (MERS-CoV) RNA sequences by real-time reverse-transcription (rRT)-PCR, with confirmation by nucleic acid sequencing when necessary [2]. The WHO recently published updated interim recommendations for MERS-CoV laboratory testing and recommends an rRT-PCR assay targeting the envelope (upE) gene for screening, followed by confirmation with an assay for the regions encoding either the open reading frame (ORF)1a, ORF1b, or the nucleocapsid protein (N). For sequencing, two target sites on the MERS-CoV genome, the RNA-dependent RNA polymerase (RdRp) and N genes, are suggested [234].
Although commercial rRT-PCR assays for MERS-CoV detection have been developed by several manufacturers, including Altona Diagnostics, Fast Track Diagnostics, and Primerdesign Ltd., studies validating diagnostic performance using authentic specimens are lacking [56].
We evaluated the analytical performance and clinical applicability of the PowerChek MERS (upE & ORF1a) real-time PCR Kit (PowerChek MERS assay; Kogene Biotech, Seoul, Korea). The PowerChek MERS assay is a recently developed one-step rRT-PCR assay for the qualitative detection of MERS-CoV-specific RNA that has received Conformity Europe-In Vitro Diagnostic (CE-IVD) and the Ministry of Food and Drug Safety (MFDS) of Korea approval. Probes specific for the upE, ORF1a, and internal control regions are labeled with the carboxy-fluorescein (FAM), 6-carboxy-4′,5′-dichloro-2′,7′-dimethoxy-fluorescein (JOE), and indodicarbocyanine (Cy5) fluorophores, respectively. This assay has been previously evaluated with only small number of clinical specimens [6]. This report presents the results of a performance evaluation of the PowerChek MERS assay using clinical respiratory specimens.

METHODS

1. Clinical specimens

The Institutional Review Board of the Samsung Medical Center, Seoul, Korea, approved this study. For analysis, 100 clinical respiratory specimens (90 sputa and 10 nasopharyngeal swabs) were collected from 100 different individuals from June to July 2015. Fifty specimens were obtained from symptomatic MERS-positive patients, and the remaining 50 were obtained from asymptomatic MERS-negative healthcare workers who were under active monitoring.
Total nucleic acid was extracted by using the QIAamp DSP Viral RNA Mini kit (Qiagen, Hilden, Germany), according to the manufacturer's instructions. A total of 140 µL of specimen was used, and the RNA was eluted in 50 µL and stored at −70℃ until testing with the PowerChek MERS and sequencing assays.

2. PowerChek MERS (upE and ORF1a) real-time PCR, RdRp, and N gene sequencing assays

MERS-CoV RNA was detected by using the PowerChek MERS assay for amplification of upE and ORF1a. The primers and probes were used according to the previous study [3]. All rRT-PCR reactions were performed by using the 7500 Fast Real-Time PCR System (Applied Biosystems, Foster City, CA, USA). The PCR reaction was performed in a total volume of 20 µL (15 µL PCR reaction mixture and 5 µL template RNA). Thermocycling conditions were as follows: 50℃ for 30 min, followed by 95℃ for 10 min, and then 40 cycles of 15 sec at 95℃ and 60 sec at 60℃. Viral template–positive controls and no-template controls were included in each run. The glyceraldehyde-3-phosphate dehydrogenase (GAPDH) gene was amplified simultaneously as a heterologous endogenous internal control to monitor PCR inhibition and specimen quality. A positive test result was defined as a well-defined exponential fluorescence curve that crossed the threshold ≤37 cycles, ≤38 cycles, and ≤35 cycles for the upE, ORF1a, and GAPDH genes, respectively.
Nested RT-PCR and sequencing targeting the RdRp and N genes were performed for confirmation, according to the previous protocols [4]. Briefly, the first round of RT-PCR for the two genes was performed by using the primer sets described in the previous report. A second round was conducted if no product was visible by agarose gel electrophoresis after the first round [4]. PCR products were sequenced by using a 3730 DNA analyzer (Applied Biosystems).

3. Analytical performance of the PowerChek MERS (upE and ORF1a) real-time PCR Kit

MERS-CoV RNA transcripts were synthesized in vitro from the T7 promoter, as previously reported [7] and were used for analytical performance evaluation. The limit of detection (LOD), the point at which 95% of the replicates of a given viral load are detected, was determined by using in vitro RNA transcripts diluted in nuclease-free water. Serial dilutions were analyzed, with 20 replicates per dilution. Probit analysis was used to determine the 95% LOD. Reproducibility, repeatability, and lot-to-lot precision were determined by using three concentrations (50, 150, and 300 copies/µL). Reproducibility was calculated by testing duplicates of each concentration in a single run for five days at two different test sites. Repeatability was calculated by testing duplicates of each concentration in a single run for 20 days. Lot-to-lot precision was accessed by testing duplicates of each concentration in a single run for five days using three different lots. Assay specificity was evaluated with nucleic acids obtained from a diverse collection of 16 respiratory virus-positive clinical specimens and 14 other respiratory bacterial isolates (13 reference strains and one clinical isolate; Table 1).

4. Diagnostic sensitivity and specificity of the PowerChek MERS (upE and ORF1a) real-time PCR Kit

The diagnostic performance of the PowerChek MERS assay and the RdRp and N gene sequencing assay was compared by measuring the positive percent agreement (PPA) and negative percent agreement (NPA) values and kappa coefficients. The RdRp and N gene sequencing assay was considered the reference standard method, and the diagnostic sensitivity and specificity of the PowerChek MERS assay were calculated.

5. Statistical analysis

Statistical analyses were performed by using the VassarStats website (http://vassarstats.net/) and the SPSS software, version 23.0 (SPSS Inc., Chicago, IL, USA). A P value <0.05 was considered statistically significant.

RESULTS

Table 2 shows the analytical sensitivity of the PowerChek MERS assay. The 95% LOD of the upE and ORF1a regions was 16.2 copies/µL (81 copies/reaction) and 8.2 copies/µL (41 copies/reaction), respectively. Table 3 shows the precision results for the PowerChek MERS assay. In the reproducibility study, the CV ranged from 0.54 to 2.10%. The assay showed acceptable repeatability, with CV results ranging from 0.54 to 2.11%. The lot-to-lot variation was acceptably low for all concentrations (CV range: 0.49–2.1%). No false-positive test results were obtained for any of these viral or bacterial isolates, but positive controls were readily detected (Table 1).
A comparison of the results of the PowerChek MERS and RdRp and N gene sequencing assays is shown in Table 4. Both methods gave positive results for all 50 clinical specimens obtained from the symptomatic MERS-positive patients. For all 50 specimens, the PowerChek MERS assay yielded positive reactions for both the upE and ORF1a targets. The range of Ct values for the upE, ORF1a, and GAPDH targets was 17.69–32.63, 19.22–34.27, and 18.51–31.17, respectively. Both methods gave negative results for all 50 specimens obtained from asymptomatic MERS-negative individuals. The two assays produced concordant results for all 100 specimens, with a kappa value of 1.00. The diagnostic sensitivity and specificity of the PowerChek MERS assay were both 100% (95% confidence interval, 91.1–100%).

DISCUSSION

To date, various reports have been published on the efficacy of rRT-PCR assays for detection of MERS-CoV-specific RNA that target various regions, including the upE, ORF1a, ORF1b, and N genes [345789]. The interim recommendations published by the WHO suggest that the upE assay be used for screening, followed by confirmation with one of the ORF1a, ORF1b, or N gene assays [2]. Similarly, the US Centers for Disease Control and Prevention (CDC) developed and use an rRT-PCR assay composed of two independent PCR reactions; one assay (N2) combined with upE testing for screening, and a second assay (N3) for confirmation of positive results [79]. Previous evaluations of the rRT-PCR assay used mock specimens spiked with cultured MERS-CoV or a small number of clinical specimens from MERS-infected patients [345781011]; this study used a total of 50 authentic clinical specimens from MERS-positive patients with various viral loads.
The PowerChek MERS assay could prevent misjudgment from sampling error, since it uses an endogenous internal control. The use of endogenous internal control would be helpful than that of artificial targets, since the endogenous internal control enables monitoring of not only the RNA extraction and reverse transcription steps but specimen quality as well [1213]. Monitoring specimen quality is important because assay performance for detection of MERS-CoV is dependent on specimen quality [14].
The PowerChek MERS assay is both simple and efficient, reducing the workload required for diagnosis. For rRT-PCR, the assay requires mixing of only the premix and RNA, which reduces the hands-on time and the risk of technical errors [515]. The turnaround time from RNA extraction to final result is 3 hr. This rapid and simple testing technique would be especially useful in managing a large MERS outbreak.
Our study has several limitations. First, the PowerChek MERS assay was validated with only upper and lower respiratory specimens. Furthermore, the 50 clinical specimens from MERS-confirmed patients were all sputum specimens. Although lower respiratory specimens are the preferred specimen type for initial MERS diagnosis because of their higher MERS-CoV load, rRT-PCR testing using other specimen types, including serum, urine, and stool specimens, is required in MERS-confirmed cases [21617]. Thus, further study to evaluate performance using other specimen types is needed. Second, we did not compare assay performance across different real-time PCR platforms. The PowerChek MERS assay was developed to allow flexibility in the choice of real-time PCR platforms, and can be used with the 7500 Fast Real-Time PCR System, CFX96 real-time PCR detection system (Bio-Rad, Hercules, CA, USA), LightCycler 480 (Roche, Mannheim, Germany), Rotor-gene Q (Qiagen, Hilden, Germany), or Mx3005P thermocycler (Agilent Technologies, CA, USA); however, we evaluated the performance using only the 7500 Fast Real-Time PCR system.
In conclusion, the PowerChek MERS assay has good diagnostic performance for detecting MERS-CoV RNA. This straightforward and accurate assay is a useful tool for the rapid diagnosis of MERS and could be especially important in control of a MERS outbreak.

Acknowledgments

This research was supported by a grant (grant number: HD15A3232) from the Korea Centers for Disease Control and Prevention.

Notes

Authors' Disclosures of Potential Conflicts of Interest: No potential conflicts of interest relevant to this article were reported.

References

1. Chan JF, Lau SK, To KK, Cheng VC, Woo PC, Yuen KY. Middle East respiratory syndrome coronavirus: another zoonotic betacoronavirus causing SARS-like disease. Clin Microbiol Rev. 2015; 28:465–522. PMID: 25810418.
2. World Health Organization. Laboratory testing for Middle East respiratory syndrome coronavirus (MERT-CoV). Interim guidance. Updated on June 2015. http://www.who.int/csr/disease/coronavirus_infections/mers-laboratory-testing/en/.
3. Corman VM, Eckerle I, Bleicker T, Zaki A, Landt O, Eschbach-Bludau M, et al. Detection of a novel human coronavirus by real-time reverse-transcription polymerase chain reaction. Euro Surveill. 2012; 17:pii:20285.
4. Corman VM, Müller MA, Costabel U, Timm J, Binger T, Meyer B, et al. Assays for laboratory confirmation of novel human coronavirus (hCoV-EMC) infections. Euro Surveill. 2012; 17:pii:20334.
5. Corman VM, Ölschläger S, Wendtner CM, Drexler JF, Hess M, Drosten C. Performance and clinical validation of the RealStar MERS-CoV Kit for detection of Middle East respiratory syndrome coronavirus RNA. J Clin Virol. 2014; 60:168–171. PMID: 24726679.
6. Kim MN, Ko YJ, Seong MW, Kim JS, Shin BM, Sung H. Analytical and clinical validation of six commercial Middle East Respiratory Syndrome coronavirus RNA detection kits based on real-time reverse-transcription PCR. Ann Lab Med. 2016; 36:450–456. PMID: 27374710.
7. Lu X, Whitaker B, Sakthivel SK, Kamili S, Rose LE, Lowe L, et al. Real-time reverse transcription-PCR assay panel for Middle East respiratory syndrome coronavirus. J Clin Microbiol. 2014; 52:67–75. PMID: 24153118.
8. Chan JF, Choi GK, Tsang AK, Tee KM, Lam HY, Yip CC, et al. Development and evaluation of novel real-time reverse transcription-PCR assays with locked nucleic acid probes targeting leader sequences of human-pathogenic coronaviruses. J Clin Microbiol. 2015; 53:2722–2726. PMID: 26019210.
9. Centers for Disease Control and Prevention. Novel coronavirus 2012 real-time RT-PCR assay. Updated on June 10, 2014. http://www.fda.gov/downloads/MedicalDevices/Safety/EmergencySituations/UCM355572.pdf.
10. Shirato K, Yano T, Senba S, Akachi S, Kobayashi T, Nishinaka T, et al. Detection of Middle East respiratory syndrome coronavirus using reverse transcription loop-mediated isothermal amplification (RT-LAMP). Virol J. 2014; 11:139. PMID: 25103205.
11. Seong MW, Lee SJ, Cho SI, Ko K, Kim MN, Sung H, et al. External quality assessment of MERS-CoV molecular diagnostics during the 2015 korean outbreak. Ann Lab Med. 2016; 36:230–234. PMID: 26915611.
12. Jung YJ, Kwon HJ, Huh HJ, Ki CS, Lee NY, Kim JW. Comparison of the AdvanSure real-time RT-PCR and Seeplex(®) RV12 ACE assay for the detection of respiratory viruses. J Virol Methods. 2015; 224:42–46. PMID: 26277911.
13. Bibby DF, McElarney I, Breuer J, Clark DA. Comparative evaluation of the Seegene Seeplex RV15 and real-time PCR for respiratory virus detection. J Med Virol. 2011; 83:1469–1475. PMID: 21678451.
14. Modjarrad K, Moorthy VS, Ben Embarek P, Van Kerkhove M, Kim J, Kieny MP. A roadmap for MERS-CoV research and product development: report from a World Health Organization consultation. Nat Med. 2016; 22:701–705. PMID: 27387881.
15. Drosten C, Doerr HW, Lim W, Stöhr K, Niedrig M. SARS molecular detection external quality assurance. Emerg Infect Dis. 2004; 10:2200–2203. PMID: 15663861.
16. Centers for Disease Control and Prevention. Interim guidelines for collecting, handling, and testing clinical specimens from patients under investigation (PUIs) for Middle East Respiratory Syndrome Coronavirus (MERS-CoV). V2.1. Updated on June 16, 2015. http://www.cdc.gov/coronavirus/mers/guidelines-clinical-specimens.html.
17. Korea Ministry of Health and Welfare and Center for Disease Control and Prevention. Guidelins for MERS-CoV control. 4-1ed. http://cdc.go.kr/CDC/info/CdcKrHealth0289.jsp?menuIds=HOME001-MNU2374-MNU2375-MNU1509-MNU1913&fid=5742&q_type=&q_value=&cid=73196&pageNum=.
Table 1

Analytical specificity of the PowerChek MERS (upE and ORF1a) real-time PCR Kit

alm-37-494-i001
Microorganism Source PowerChek MERS assay
Viruses
 Adenovirus Clinical specimen* Negative
 Bocavirus Clinical specimen* Negative
 Coronavirus 229E Clinical specimen* Negative
 Coronavirus OC43 Clinical specimen* Negative
 Coronavirus HKU1 Clinical specimen* Negative
 Coronavirus NL63 Clinical specimen* Negative
 Human enterovirus Clinical specimen* Negative
 Human metapneumovirus Clinical specimen* Negative
 Human rhinovirus Clinical specimen* Negative
 Influenza A Clinical specimen* Negative
 Influenza B Clinical specimen* Negative
 Parainfluenza 1 Clinical specimen* Negative
 Parainfluenza 2 Clinical specimen* Negative
 Parainfluenza 3 Clinical specimen* Negative
 Respiratory syncytial virus A Clinical specimen* Negative
 Respiratory syncytial virus B Clinical specimen* Negative
Bacteria
 Acinetobacter baumannii Reference strain (ATCC 19606) Negative
 Escherichia coli Reference strain (ATCC 25922) Negative
 Haemophilus influenza Reference strain (ATCC 9007) Negative
 Klebsiella pneumoniae Reference strain (ATCC 900603) Negative
 Legionella pneumophila Reference strain (ATCC 33156) Negative
 Mycoplasma pneumoniae Clinical specimen Negative
 Mycobacterium tuberculosis Reference strain (ATCC 27294) Negative
 Mycobacterium avium Reference strain (KMRC 00136-41011) Negative
 Mycobacterium abscessus Reference strain (ATCC 19977) Negative
 Pseudomonas aeruginosa Reference strain (ATCC 27853) Negative
 Staphylococcus aureus Reference strain (ATCC 25923) Negative
 Staphylococcus epidermidis Reference strain (ATCC 12228) Negative
 Streptococcus pneumoniae Reference strain (ATCC 49619) Negative
 Streptococcus pyogenes Reference strain (ATCC 19615) Negative

*Specimens that yielded positive results in two respiratory virus panel assays: the AdvanSure RV real-time PCR Kit (LG chem, Seoul, Korea) and the Allplex Respiratory Panel 1, 2, and 3 (Seegene, Seoul, Korea); Specimens confirmed by sequencing analysis.

Abbreviation: KMRC, Korea Mycobacterium Resource Center.

Table 2

Analytical sensitivity of the PowerChek MERS (upE and ORF1a) real-time PCR Kit

alm-37-494-i002
Concentration (copies/µL) N of detections/N of replicates (%)
upE ORF1a
100 20/20 (100) 20/20 (100)
50 20/20 (100) 20/20 (100)
25 20/20 (100) 20/20 (100)
12.5 17/20 (85) 20/20 (100)
10 18/20 (90) 19/20 (95)
Table 3

Precision of the PowerChek MERS (upE and ORF1a) real-time PCR Kit

alm-37-494-i003
Target Concentration (copies/µL) Mean Ct (% coefficient of variation)
Reproducibility Repeatability Lot-to-lot variation
Site 1 Site 2 Lot 1 Lot 2 Lot 3
upE 50 34.40 (2.10) 34.40 (1.32) 34.74 (2.11) 34.40 (2.10) 34.45 (3.36) 34.40 (2.10)
150 32.68 (0.89) 32.85 (1.19) 32.92 (1.06) 32.68 (0.89) 32.82 (0.97) 32.68 (0.89)
300 31.91 (0.54) 31.99 (0.88) 31.97 (0.77) 31.91 (0.54) 31.98 (0.68) 31.91 (0.54)
ORF1a 50 33.93 (1.30) 33.90 (0.86) 34.07 (1.53) 33.93 (1.30) 34.14 (1.34) 34.04 (1.21)
150 32.16 (0.79) 32.11 (0.63) 32.23 (0.77) 32.16 (0.79) 32.31 (0.77) 32.27 (0.49)
300 30.88 (0.62) 30.78 (0.62) 30.91 (0.54) 30.88 (0.62) 30.85 (1.15) 30.98 (0.70)

Abbreviation: Ct, Cycle threshold.

Table 4

Comparison of the PowerChek MERS (upE and ORF1a) real-time PCR Kit and the sequencing assay for the detection of MERS-CoV

alm-37-494-i004
Detection method Result Subject characteristics Total
Symptomatic
MERS-confirmed patients
Asymptomatic
MERS-negative individuals
PowerChek MERS (upE and ORF1a) real-time PCR Kit Positive 50 0 50
Negative 0 50 50
RdRp and N gene sequencing assay Positive 50 0 50
Negative 0 50 50
Total 50 50 100

Positive percent agreement, 100% (91.1–100%).

Negative percent agreement, 100% (91.1–100%).

Kappa coefficient, 1.00.

Abbreviations: MERS, Middle East respiratory syndrome; RdRp, RNA-dependent RNA polymerase.

TOOLS
Similar articles