Journal List > J Gynecol Oncol > v.25(4) > 1079135

Guo, You, Geng, and Qiao: The clinical performance of APTIMA human papillomavirus and Hybrid Capture 2 assays in the triage of lesser abnormal cervical cytologies

Abstract

Objective

This study was performed to evaluate the clinical performance of APTIMA human papillomavirus (AHPV) assay and Hybrid Capture 2 (HC2) assay in screening for cervical disease, especially in women with atypical squamous cell of undetermined significance (ASC-US) and low-grade squamous intraepithelial lesion (LSIL).

Methods

A total of 411 women diagnosed with ASC-US or LSIL were referred and further triaged by HC2 test. Prior to colposcopy, liquid-based cytology specimens were collected for the AHPV assay. Sensitivity and specificity were established based on the histological findings of cervical intraepithelial neoplasia (CIN).

Results

In all 411 subjects, the positive detection rate of AHPV assay was 70.8% (95% confidence interval [CI], 66.4 to 75.2), which was significantly lower than the positive detection rate of 94.9% obtained using HC2 test (95% CI, 92.3 to 96.8). Only one CIN 3-positive case was detected among the 120 AHPV-negative women, which was then confirmed by Pap smear test to be LSIL. The sensitivities of AHPV and HC2 for CIN 3 were similar (94.1% and 100%, respectively). However, AHPV showed a significantly higher specificity than HC2 test (30.2% and 5.3%, respectively; p<0.001).

Conclusion

AHPV assay is effective in identifying CIN 3-positive cases because of its high specificity and lower false-negative rate. The use of AHPV for the triage of ASC-US and LSIL might help to reduce the referral rate of colposcopy during cervical cancer screening.

INTRODUCTION

Cervical cancer is the second most common form of cancer among females worldwide [1] and the most common form of gynecological cancer in some developing countries [2] because of lack of screening programs. The Papanicolaou test (called Pap test) is a screening test for the detection of potentially precancerous and cancerous processes in the endocervical canal of the female reproductive system. The most frequent abnormal results of Pap test comprises atypical squamous cell of undetermined significance (ASC-US, typically 2% to 5%) and low-grade squamous intraepithelial lesion (LSIL, about 2%) [3], which indicates infection with human papillomavirus (HPV). Persistent infection with high-risk HPV (HR-HPV) is the main cause of cervical cancer and its precursor lesion, cervical intraepithelial neoplasia (CIN) [4,5]. Patients with positive findings for ASC-US or LSIL are frequently asked to undergo HPV screening [6]. Thus, carcinogenic HPV testing has been widely employed for the screening of primary cervical cancer in women aged 30 years and above [7,8,9].
Several studies have shown that testing for HPV DNA has high sensitivity but low specificity [9,10,11]. It is, therefore, a challenge to discriminate between transient and persistent infections, necessitating the requirement of a test with improved specificity for the detection of the presence of HPV. HPV has a small, double-stranded, circular DNA that encodes 8 genes. Some of the genes such as E6 and E7 are known to act as oncogenes that promote tumor growth and malignant transformation [12]. E6 and E7 oncogenes are overexpressed in the malignant phenotype. Moreover, the oncogenic potential of HPV infection is associated with the expression of E6 and E7 oncoproteins. The presence of HR-HPV DNA does not always lead to the disease, but the detection of this transient infection invariably points to an increased risk for disease development in women. Recent studies [13,14] have demonstrated that the detection of E6/E7 mRNAs may facilitate the screening for malignant lesions. Also, the specificity of detecting high-grade lesions is higher by using HPV mRNA-based assay than by using HPV DNA-based assay. The APTIMA HPV (AHPV) assay has been used for the detection of HPV E6/E7 mRNA in all 14 HR-HPV types and shows greater accuracy than HPV DNA-based tests in triage settings [14,15].
To the best of our knowledge, the present study is the first to compare AHPV with HC2 in a referral population in China. The performance of both assays was evaluated in the whole cohort, which was further stratified according to cytology.

MATERIALS AND METHODS

1. Patients and specimen collection

This study was performed at the Third Hospital of Peking University from February 5, 2013, to August 27, 2013. The referred women were eligible if they were not pregnant and had no history of CIN diagnosis and hysterectomy. Before referral, all women underwent liquid-based cytology test, as recommended by gynecologists, by using smears that were stored at the Third Hospital of Peking University. All women signed a written consent before sample collection. The procedures were approved by the Ethics Committee for Medical Science Research at Third Hospital of Peking University. The results obtained for 600 cases were reviewed and classified according to the 2001 Bethesda system. If the result was normal, ASC could not rule out high-grade SIL, high-grade SIL, atypical glandular cells, or cancer, and the data were excluded. A total of 411 women (median age, 34 years; range, 21 to 69 years) were enrolled, of which 231 women had ASC-US and 180 women had LSIL. Upon enrollment, a single cervical specimen was collected from all participants by using a Cervex broom-type brush (Rovers Medical Devices, Oss, Netherlands), according to the manufacturer's instructions. The median interval time from the initial cytological diagnosis and enrollment to the colposcopy referral visit was 27 days (from 5 to 90 days).

2. Colposcopy and histology

Colposcopy was performed by two experienced gynecologists. Colposcopically directed punch biopsy was performed on the day of patient enrollment, according to the standard of care. Cervical histology was read and reviewed independently by experienced pathologists; the result was used as the disease endpoint for the purpose of the study. The pathologists were blinded to HPV results.

3. APTIMA HPV assay

AHPV assay (Gen-Probe Inc., San Diego, CA, USA) was designed to detect HPV E6/E7 mRNA from liquid cervical specimens of 14 high-risk oncogenic types (HPV-16, -18, -31, -33, -35, -39, -45, -51, -52, -56, -58, -59, -66, and -68). The procedure was carried out according to the manufacturer's instructions. Briefly, a 1-mL aliquot of each of the PreservCyt sample was transferred to 2.9 mL of buffered detergent solution. A 400-µL aliquot of this mix was then tested on a semiautomated Direct Tube Sampling system (Gen-Probe). Assay results were determined on the basis of the signal-to-cutoff ratio (S/CO) for the analyte. Specimens with an S/CO value of ≥1.0 were considered positive.

4. HC2 assay

HC2 (Qiagen, Mississauga, ON, Canada) assay was used to detect the DNA of 13 high-risk oncogenic types (HPV-16, -18, -31, -33, -35, -39, -45, -51, -52, -56, -58, -59, and -68). RNA-DNA hybrids were prepared using a RNA probe cocktail and the target DNA. The hybrids were then captured by specific antibodies and detected by chemiluminescence substrate. This test was performed with 4 mL of PreservCyt sample in conversion buffer as per the manufacturer's instructions. Specimens with a relative light unit/cutoff ratio of ≥1.0 were considered positive.

5. Statistical analysis

The clinical performance of the HPV test was established by comparing the test result against the disease endpoint founded on histologically confirmed CIN 2 or greater (CIN 2+) and CIN 3 or greater (CIN 3+) samples. Sensitivity and specificity were calculated using the conventional contingency tables. The 95% confidence intervals (CIs) were computed using the binomial method. McNemar's chi-square test was used to test for the difference between their sensitivities and specificities, as they were both calculated using the same set of samples. The accuracy of AHPV and HC2 assays was calculated as the percentage of correct results from one HPV test in comparison to the results of histological analysis. A significance level of 0.05 was used to compare performance characteristics. No adjustments were made for multiple comparisons. All statistical analyses were carried out using the SPSS ver. 13.0 (SPSS Inc., Chicago, IL, USA).

RESULTS

1. Prevalence of cervical disease

A total of 411 subjects were tested using histology, cytology, AHPV, and HC2 techniques, and the results were analyzed. Histology results revealed that 339 participants were normal or were classified as CIN 1 (<CIN 2), while 55 and 17 subjects were classified as CIN 2 and CIN 3, respectively. Thus, the prevalence of cervical disease (CIN 2+) in the referred population was 17.5% (95% CI, 13.8 to 21.2).

2. Detection of cervical disease by AHPV assay, HC2 test, and cytology

The performance of AHPV and HC2 assays were determined and compared with the histology results. The results are presented in Table 1. For AHPV assay, the positive results increased with the severity of histological abnormality (from normal to CIN 3). The positive detection rate of AHPV assay was 67.5% (95% CI, 61.5 to 73.6) in ASC-US specimens and 75% (95% CI, 68.0 to 81.1) in LSIL specimens, which was significantly lower than that of HC2 test (95.2% in ASC-US and 94.4% in LSIL, p<0.001). In all 411 participants, the positive detection rate of AHPV assay (70.8%) was significantly lower than that of HC2 test (94.9%; p<0.001).

3. Sensitivity and specificity of AHPV assay and HC2 test in the screening of cervical disease

According to the results of histological and cytological analyses, 30 specimens of the 231 ASC-US subjects (13.0%) were identified as CIN 2+ and 42 specimens of the 180 LSIL subjects (23.3%) were classified as CIN 2+. Based on a total of 411 cases, the sensitivity of AHPV assay for the detection of CIN 2+ and CIN 3 was 87.5% and 100%, respectively, while the sensitivity of HC2 test was 100% for both CIN 2+ and CIN 3 subjects (Table 2). The specificity of AHPV assay for the detection of CIN 2+ and CIN 3 specimens was 32.7% and 30.2%, respectively, while the specificity of HC2 test was 6.2% for CIN 2+ and 5.3% for CIN 3. Thus, AHPV assay has a significantly higher specificity than the HC2 test (p<0.001).

4. False-negative cases by AHPV assay

In the referred cohort of 120 AHPV-negative cases, only nine CIN 2+ cases were detected (one CIN 3 and eight CIN 2) (Table 3). In case of HC2 test, all 55 CIN 3 and 17 CIN 2 cases were HC2-positive and no false negative case was observed.

DISCUSSION

The present study, to the best of our knowledge, is the first clinical experiment in a referred cohort to evaluate the performance of the AHPV assay for cervical cancer screening in China. We evaluated the clinical performance of the assays in 411 subjects with ASC-US/LSIL. This study demonstrated that both assays had high sensitivity (>86%) for the detection of high-grade cervical lesions (CIN 2+). HC2 assay identified more CIN 2 cases than AHPV assay, which is consistent with other studies [15,16,17].
Few CIN 2 cases spontaneously regress and do not progress into CIN 3 or cancer [18,19,20] but the CIN 3 patients develop invasive cervical cancer if left untreated [21]. Timely detection of CIN 3 is thus crucial for treatment. This study was conducted to evaluate the clinical performance of AHPV assay in screening CIN 3 specimens. It was concluded that AHPV has good sensitivity and specificity in screening of CIN 3 cases. In addition, the possibility of the presence of CIN 3 in AHPV-negative specimens was as less as 0.8% (Table 3). These data indicate that AHPV is a reliable assay for screening precancerous and cancerous cervical specimens.
HC2 assay is the first FDA-approved and widely used procedure for HPV testing based on quantitative detection of L1 in 13 HR-HPV types [22]. The HC2 test has good sensitivity, but it cross-reacts with some low-risk HPV types [22,23], resulting in relatively low clinical specificity for high-grade cervical lesions [7,24,25,26]. Hence, an improvement in specificity is desired to reduce the referral rate of colposcopy.
The expression of viral oncogene E6 and E7 mRNA in HPV-transformed basal keratinocytes is essential for the development and progression of cervical cancer. These genes are mildly expressed during transient infections [5,27]. Unearthing biomarkers may assist the generation of a more specific assay for the detection of viral DNA that can accelerate the progression of abnormalities to cervical cancer [28,29].
AHPV assay is a procedure targeting E6/E7 mRNA of 14 HR-HPV types. It does not cross-react with the low-risk HPV types [30]. Some previous studies [26,31] have demonstrated that AHPV has good sensitivity along with significantly higher specificity for the detection of CIN 2+ and CIN 3+ as compared to HC2 test; our data verified this piece of information.
In this study, fewer specimens were tested positive by AHPV assay than that by HC2 test, especially in cases with normal or CIN 1 histology. This finding can be explained by the fact that the HC2 test is very sensitive to the presence of HPV DNA, and consequently, it cannot be used as a factor for evaluating the risk of cervical precancerous cells progressing to cervical cancer. The AHPV assay, on the other hand, is expected to detect fewer CIN 2 cases than HC2 assay, because some CIN 2 lesions are more likely to be transient and spontaneously regress. Low sensitivity of AHPV assay in detecting CIN 2 can be attributed to regional factor or race factor. These results indicate that the application of AHPV assay in China has good potential to further triage ASC-US/LSIL specimens and can obviously reduce a patient's burden and health care-related cost due to unnecessary colposcopy.
This study has several advantages. First, the data were obtained from a well-designed clinical experiment. Second, the biopsy samples were used as the gold standard. Biopsies were taken from the women referred to colposcopy. Colposcopic impression was also normal. However, there are few limitations of this study. First, it is a cross-sectional study and not a prospective, randomized controlled trial. Second, the study did not include HPV genotyping data, which might partly explain the difference in clinical specificity between AHPV and HC2. Third, it should be noted that women in this cohort were referred for colposcopy because of a previously abnormal Pap test. Some HC2-negative cases had been excluded. Fourth, the number of CIN 2/3 specimens was not large; therefore, further evaluation is necessary to establish the clinical performance of AHPV assay in a larger population size. Moreover, a CIN 3 specimen was misdiagnosed by AHPV assay; therefore, the procedure used for AHPV should be improved and additional methods for screening cervical disease should be discovered for future studies.
Results from this referral study show that the AHPV assay offers high sensitivity for high-grade disease and has a significantly higher specificity compared to the HC2 test. The greater performance of the AHPV assay provides supporting data for its application in cervical cancer screening as an ASC-US triage test, which may improve patient management and reduce health care costs. Further work is, however, essential to confirm these findings in a primary cervical disease screening setting.

Figures and Tables

Table 1
The performance of AHPV assay and HC2 test by cytology and histology
jgo-25-287-i001

AHPV, APTIMA human papillomavirus; ASC-US, atypical squamous cell of undetermined significance; CI, confidence interval; CIN, cervical intraepithelial neoplasia; HC2, Hybrid Capture 2; LSIL, low-grade squamous intraepithelial lesion.

Table 2
The sensitivity and specificity of AHPV assay and HC2 test for screening CIN 2/3+ by cytologic abnormalities
jgo-25-287-i002

AHPV, APTIMA human papillomavirus; ASC-US, atypical squamous cell of undetermined significance; CI, confidence interval; CIN, cervical intraepithelial neoplasia; HC2, Hybrid Capture 2; LSIL, low-grade squamous intraepithelial lesion.

Table 3
Cervical disease in AHPV-negative, AHPV-positive, and HC2-positive
jgo-25-287-i003

AHPV, APTIMA human papillomavirus; ASC-US, atypical squamous cell of undetermined significance; CI, confidence interval; CIN, cervical intraepithelial neoplasia; HC2, Hybrid Capture 2; LSIL, low-grade squamous intraepithelial lesion.

ACKNOWLEDGMENTS

The authors gratefully acknowledge the excellent technical assistance of Fan-Xue Kong. We sincerely thank those patients who participated in this study.

Notes

No potential conflict of interest relevant to this article was reported.

References

1. World Health Organization. Cervical cancer, human papillomavirus (HPV), and HPV vaccines: key points for policy-makers and health professionals 2007 [Internet]. Geneva: World Health Organization;2007. cited 2014 Aug 20. Available at: http://www.path.org/publications/detail.php?i=1621.
2. Kim K, Zang R, Choi SC, Ryu SY, Kim JW. Current status of gynecological cancer in China. J Gynecol Oncol. 2009; 20:72–76.
3. Davey DD, Neal MH, Wilbur DC, Colgan TJ, Styer PE, Mody DR. Bethesda 2001 implementation and reporting rates: 2003 practices of participants in the College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology. Arch Pathol Lab Med. 2004; 128:1224–1229.
4. Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, et al. Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol. 1999; 189:12–19.
5. Schiffman M, Castle PE, Jeronimo J, Rodriguez AC, Wacholder S. Human papillomavirus and cervical cancer. Lancet. 2007; 370:890–907.
6. Massad LS, Einstein MH, Huh WK, Katki HA, Kinney WK, Schiffman M, et al. 2012 updated consensus guidelines for the management of abnormal cervical cancer screening tests and cancer precursors. Obstet Gynecol. 2013; 121:829–846.
7. Wright TC Jr, Schiffman M, Solomon D, Cox JT, Garcia F, Goldie S, et al. Interim guidance for the use of human papillomavirus DNA testing as an adjunct to cervical cytology for screening. Obstet Gynecol. 2004; 103:304–309.
8. Naucler P, Ryd W, Tornberg S, Strand A, Wadell G, Elfgren K, et al. Human papillomavirus and Papanicolaou tests to screen for cervical cancer. N Engl J Med. 2007; 357:1589–1597.
9. Bulkmans NW, Berkhof J, Rozendaal L, van Kemenade FJ, Boeke AJ, Bulk S, et al. Human papillomavirus DNA testing for the detection of cervical intraepithelial neoplasia grade 3 and cancer: 5-year follow-up of a randomised controlled implementation trial. Lancet. 2007; 370:1764–1772.
10. Cuzick J, Clavel C, Petry KU, Meijer CJ, Hoyer H, Ratnam S, et al. Overview of the European and North American studies on HPV testing in primary cervical cancer screening. Int J Cancer. 2006; 119:1095–1101.
11. Mayrand MH, Duarte-Franco E, Rodrigues I, Walter SD, Hanley J, Ferenczy A, et al. Human papillomavirus DNA versus Papanicolaou screening tests for cervical cancer. N Engl J Med. 2007; 357:1579–1588.
12. Burd EM. Human papillomavirus and cervical cancer. Clin Microbiol Rev. 2003; 16:1–17.
13. Kraus I, Molden T, Holm R, Lie AK, Karlsen F, Kristensen GB, et al. Presence of E6 and E7 mRNA from human papillomavirus types 16, 18, 31, 33, and 45 in the majority of cervical carcinomas. J Clin Microbiol. 2006; 44:1310–1317.
14. Arbyn M, Roelens J, Cuschieri K, Cuzick J, Szarewski A, Ratnam S, et al. The APTIMA HPV assay versus the Hybrid Capture 2 test in triage of women with ASC-US or LSIL cervical cytology: a meta-analysis of the diagnostic accuracy. Int J Cancer. 2013; 132:101–108.
15. Dockter J, Schroder A, Hill C, Guzenski L, Monsonego J, Giachetti C. Clinical performance of the APTIMA HPV Assay for the detection of high-risk HPV and high-grade cervical lesions. J Clin Virol. 2009; 45:Suppl 1. S55–S61.
16. Monsonego J, Hudgens MG, Zerat L, Zerat JC, Syrjanen K, Halfon P, et al. Evaluation of oncogenic human papillomavirus RNA and DNA tests with liquid-based cytology in primary cervical cancer screening: the FASE study. Int J Cancer. 2011; 129:691–701.
17. Szarewski A, Ambroisine L, Cadman L, Austin J, Ho L, Terry G, et al. Comparison of predictors for high-grade cervical intraepithelial neoplasia in women with abnormal smears. Cancer Epidemiol Biomarkers Prev. 2008; 17:3033–3042.
18. Castle PE, Schiffman M, Wheeler CM, Solomon D. Evidence for frequent regression of cervical intraepithelial neoplasia-grade 2. Obstet Gynecol. 2009; 113:18–25.
19. Castle PE, Stoler MH, Solomon D, Schiffman M. The relationship of community biopsy-diagnosed cervical intraepithelial neoplasia grade 2 to the quality control pathology-reviewed diagnoses: an ALTS report. Am J Clin Pathol. 2007; 127:805–815.
20. Trimble CL, Piantadosi S, Gravitt P, Ronnett B, Pizer E, Elko A, et al. Spontaneous regression of high-grade cervical dysplasia: effects of human papillomavirus type and HLA phenotype. Clin Cancer Res. 2005; 11:4717–4723.
21. McCredie MR, Sharples KJ, Paul C, Baranyai J, Medley G, Jones RW, et al. Natural history of cervical neoplasia and risk of invasive cancer in women with cervical intraepithelial neoplasia 3: a retrospective cohort study. Lancet Oncol. 2008; 9:425–434.
22. Castle PE, Solomon D, Wheeler CM, Gravitt PE, Wacholder S, Schiffman M. Human papillomavirus genotype specificity of hybrid capture 2. J Clin Microbiol. 2008; 46:2595–2604.
23. Digene Hybrid Capture 2 High-Risk HPV DNA Test. Gaithersburg, MD: Digene Co.;2007.
24. Reuschenbach M, Clad A, von Knebel Doeberitz C, Wentzensen N, Rahmsdorf J, Schaffrath F, et al. Performance of p16INK4a-cytology, HPV mRNA, and HPV DNA testing to identify high grade cervical dysplasia in women with abnormal screening results. Gynecol Oncol. 2010; 119:98–105.
25. Clad A, Reuschenbach M, Weinschenk J, Grote R, Rahmsdorf J, Freudenberg N. Performance of the Aptima high-risk human papillomavirus mRNA assay in a referral population in comparison with Hybrid Capture 2 and cytology. J Clin Microbiol. 2011; 49:1071–1076.
26. Castle PE, Dockter J, Giachetti C, Garcia FA, McCormick MK, Mitchell AL, et al. A cross-sectional study of a prototype carcinogenic human papillomavirus E6/E7 messenger RNA assay for detection of cervical precancer and cancer. Clin Cancer Res. 2007; 13:2599–2605.
27. Sotlar K, Stubner A, Diemer D, Menton S, Menton M, Dietz K, et al. Detection of high-risk human papillomavirus E6 and E7 oncogene transcripts in cervical scrapes by nested RT-polymerase chain reaction. J Med Virol. 2004; 74:107–116.
28. Cuschieri KS, Whitley MJ, Cubie HA. Human papillomavirus type specific DNA and RNA persistence: implications for cervical disease progression and monitoring. J Med Virol. 2004; 73:65–70.
29. Czegledy J, Iosif C, Hansson BG, Evander M, Gergely L, Wadell G. Can a test for E6/E7 transcripts of human papillomavirus type 16 serve as a diagnostic tool for the detection of micrometastasis in cervical cancer? Int J Cancer. 1995; 64:211–215.
30. Dockter J, Schroder A, Eaton B, Wang A, Sikhamsay N, Morales L, et al. Analytical characterization of the APTIMA HPV Assay. J Clin Virol. 2009; 45:Suppl 1. S39–S47.
31. Ratnam S, Coutlee F, Fontaine D, Bentley J, Escott N, Ghatage P, et al. Aptima HPV E6/E7 mRNA test is as sensitive as Hybrid Capture 2 Assay but more specific at detecting cervical precancer and cancer. J Clin Microbiol. 2011; 49:557–564.
TOOLS
Similar articles