Journal List > J Korean Med Sci > v.33(53) > 1109814

Jung, Oh, Kim, Jung, Seok, Lee, Park, Lim, Kim, Kim, and Choi: Clinical Validation of a Protein Biomarker Panel for Non-Small Cell Lung Cancer

Abstract

We validated the diagnostic performance of a previously developed blood-based 7-protein biomarker panel, AptoDetect™-Lung (Aptamer Sciences Inc., Pohang, Korea) using modified aptamer-based proteomic technology for lung cancer detection. Non-small cell lung cancer (NSCLC), 200 patients and benign nodule controls, 200 participants were enrolled. In a high-risk population corresponding to ≥ 55 years of age and ≥ 30 pack-years, the diagnostic performance was improved, showing 73.3% sensitivity and 90.5% specificity with an area under the curve of 0.88. AptoDetect™-Lung (Aptamer Sciences Inc.) offers the best validated performance to discriminate NSCLC from benign nodule controls in a high-risk population and could play a complementary role in lung cancer screening.

Graphical Abstract

jkms-33-e342-abf001.jpg

Lung cancer remains the leading cause of cancer-related deaths in Korea and worldwide.12 The major method of screening, low-dose computed tomography (LDCT), was validated in the landmark National Lung Screening Trial (NLST), where LDCT demonstrated a 20% relative reduction in lung cancer-related mortality in a high-risk population.3
Although LDCT screening for lung cancer is associated with the low specificity (73.4%)4 and the resulting high rate of false-positives (96.4%),3 annual LDCT-screening for lung cancer was recently recommended for high-risk individuals.5 However, in this recommendation, the need for more research into the use of biomarkers to complement LDCT screening was also stressed.56
Aptamers, defined as single chain nucleotide ligands, have been developed as novel capture arrays that share many features with antibodies.78 Owing to its innate property,8 aptamer technology enables the development of a highly multiplexed proteomic assay to analyze multiple proteins in complex biological samples.9 Recently, an aptamer-based high-throughput proteomics assay, the slow off-rate modified aptamers (SOMAmers) scan was developed10 and it identified several candidate biomarkers for non-small cell lung cancers (NSCLCs).11 Mehan and colleagues12 discovered that 15 robust biomarkers was selected using the SOMA scan and a 7-marker random forest classifier was built. These studies have supported the application of aptamers in the development of lung cancer biomarkers in the US population with the potential to complement the current screening standards. Our previous study investigated candidate biomarkers in the Korean population using a new modified aptamer-based proteomic technology and developed a 7-protein panel (AptoDetect™-Lung, Aptamer Sciences Inc., Pohang, Korea) that discriminates lung cancers from controls with an area under the curve (AUC) of 0.82 and 0.77 in the training and verification sets, respectively.13
In this study, we sought to validate the performance of AptoDetect™-Lung for lung cancer detection in an independent and larger Korean population.
A total of 430 participants were screened, and 200 patients with biopsy-proven NSCLC and 200 participants as benign nodule controls were enrolled from three study centers; the two lung cancer cohorts of the Chonnam National University Hospital, the Asan Medical Center of University of Ulsan College of Medicine, and a Health Promotion Center of the Asan Medical Center (Fig. 1).
The subject exclusion criteria were age < 20 or > 80 years, the lack of nodule size or histopathologic cancer diagnosis, a diagnosis of small-cell lung cancer or a history of other malignancy.
Clinical data and blood samples were collected from the NSCLC group diagnosed with pathologic or clinical stage I–IV NSCLC. Blood samples were collected within 4 weeks of the first biopsy-proven lung cancer diagnosis and before treatment or removal of the tumor by standard surgical procedures. The benign nodule control group consisted of subjects who received a lung health screening exam from November 2016 to February 2017. Chest computed tomography (CT) and blood sampling was collected simultaneously with the CT scan. All participants were followed with LDCT and determined to be cancer-free after a minimum of 1-year follow-up.
In order to assess the samples, biomarkers were measured using the AptoDetect™-Lung kit, which was developed in a previous study.13 Briefly, to select of the panel of the biomarker, we used the Naïve Bayes method to systematically assess potential biomarker performance, and the Naïve Bayes classifier was developed a diagnostics model that generated the probability a patient has lung cancer given their protein biomarker levels. Serum concentrations of seven proteins (EGFR1, MMP7, CA6, KIT, CRP, C9, and SERPINA3) were measured using an aptamer-based multiplex assay and the likelihood ratio was calculated for each sample. To simplify the score, the likelihood ratio was transformed to a risk stratification score spanning 0–10. We employed a cut-off of 5 points, which had 75% sensitivity and 91.7% specificity for NSCLC patients against benign nodule controls.13 Samples with a score ≥ 5 were considered positive and high-risk, whereas samples with a score < 5 were considered negative and low-risk. As described in a previous report, we studied the accuracy of AptoDetect™-Lung by comparing sensitivity and specificity and used the AUC of the receiver operating characteristic curve to compare candidate classifier performance.13
Student's t-tests or Mann-Whitney U tests were used to compare continuous variables, and χ2 tests or Fisher's exact tests were used to compare categorical variables. Analyses were performed using SPSS for Windows Version 21.0 (SPSS Inc., Chicago, IL, USA) and SAS for Windows Version 9.4 (SAS Institute, Cary, NC, USA). Two-sided P values < 0.05 were considered to be statistically significant.
The median age of the NSCLC group was 65 years (range, 27–79 years), whereas the median age of the benign nodule control group was 56 years (range, 21–76 years). There was no difference in gender and smoking history between two groups. The mean pack-years in the NSCLC was significantly higher than that of the benign nodule control (38.12 ± 24.93 vs. 30.48 ± 17.29; P = 0.016). In the NSCLC, 53% (106/200) of cases were adenocarcinoma and 47% (94/200) of cases were squamous cell carcinoma (Table 1).
Based on AptoDetect™-Lung scores, the NSCLC and benign nodule control groups were divided into low-risk (negative) (< 5) and high-risk (positive) (≥ 5). Of the 171 cases categorized as high-risk, 137 (80.1%) were NSCLC cases and 34 (19.9%) were benign nodule control cases. The 229 cases categorized as low-risk included 166 (72.5%) benign nodule control and 63 (27.5%) NSCLC.
The result of clinical performance showed that AptoDetect™-Lung for discriminating NSCLC from benign nodule controls had a sensitivity and specificity of 68.5% and 83.0%, respectively, and the AUC was 0.79. The AUC of the AptoDetect™-Lung in discriminating between early stages (I and II) and benign nodule controls was 0.70, and it was 0.86 for discriminating between stage III and IV and benign nodule controls (Fig. 2A). AptoDetect™-Lung also accurately divided the most prevalent NSCLC histological types; the AUC for squamous cell carcinoma was 0.90 and the AUC for adenocarcinoma was 0.69 (Fig. 2B).
The high-risk population (n = 128) in this study corresponding to more than 55 years of age and a smoking history of 30 pack-years consisted of 86 (67.2%) NSCLC and 42 (33.1%) benign nodule control cases. AptoDetect™-Lung had a sensitivity and specificity of 73.3% and 90.5%, respectively, and the AUC was 0.88, indicating the good discrimination among this group (Fig. 2C).
The main concern raised by clinicians performing lung cancer CT screening is the high prevalence of one or more lung nodules, with many being undiagnosed as either malignant or benign.36 In Korea, LDCT screening showed that 35% of subjects had at least one or more non-calcified lung nodule, and lung cancer detection rates were 0.36%.14 In the organized, controlled setting of LDCT randomized and cohort screening studies, the rate of invasive procedures was low, varying from 1% to 4%.15 However, approximately 25% of invasive procedures are performed in patients with nodules that are eventually shown to be benign (range, 0%–45%).316 Consequently, there is an unmet need for biomarkers that can discriminate between benign and malignant nodules to complement CT-based diagnosis. This corresponds to the specificity of the test in determining the percentage of benign nodules correctly called benign (that is, negative) by the test. Thus, the higher the specificity at a given high negative predictive value, the more patients with benign nodules that do not have to undergo the unnecessary invasive procedures.17 AptoDetect™-Lung suggested more than 90% specificity in the high-risk population. This is similar to the result from the EarlyCDT®-Lung (Innovative Diagnostic Laboratory, Richmond, VA, USA) test, which showed 90% specificity and 41% sensitivity.18
AptoDetect™-Lung showed an excellent AUC of 0.90 for squamous cell carcinoma. NLST showed that by tumor histology, mortality risk ratio was 0.75 for adenocarcinoma, 0.71 for all NSCLC except squamous, 1.23 for squamous cell carcinoma.19 In addition, squamous cell carcinoma is the NSCLC histology most commonly undetected by CT, perhaps because the central tumor location obscures CT detection and it tends to have a rapid growth rate that can lead to diagnosis as interval tumors.13 Therefore, AptoDetect™-Lung has the advantage of high specificity for detecting squamous cell carcinoma, and it might have a complementary role in lung cancer screening.
Currently, Lung Imaging Reporting and Data System (Lung-RADS) which defines a positive screening test and provides patient's clinical management recommendations based on level of risk, has been adopted at many academic medical centers in the US.20 Integration of AptoDetect™-Lung into Lung-RADS may increase the accuracy of nodule classification, and suggest the strategy to guide the lung nodule management leading to a decrease in unnecessary follow-up imaging or invasive procedures, and potentially avoid unnecessary morbidity, mortality, and health care costs.
AptoDetect™-Lung offers the best validated performance to discriminate NSCLC from benign nodules in a high-risk population that corresponds to more than 55 years of age and a smoking history of at least 30 pack-years and could serve a complementary role in lung cancer screening. Additionally, large prospective trials are needed to validate the improved efficacy and utility in clinical practice for screening and diagnostic processes by pairing AptoDetect™-Lung with clinical management recommendations in lung cancer screening CT.

ACKNOWLEDGMENTS

The biospecimens and data were provided by the Biobank of Chungnam University Hospital, a member of the Korea Biobank Network, and they used to compare with the other malignancy except lung cancer as a basic analysis.

Notes

Disclosure: The authors have read the journal's policies and have the following conflict: Kim Y, Jung JH, and Seok M are employees of Aptamer Sciences Inc. Although the present study used AptoDetectTM-Lung, a product of Aptamer Sciences Inc., the 3 co-researchers did not involve study design and data analysis that made any biased influence. The whole study was free from conflicts of interest. These facts do not alter the authors' adherence to Journal Korean Medical Science policies on the sharing of data and material. Jung YJ, Oh IJ, Lee W, Park CK, Lim JH, Kim YC, Kim WS, and Choi CM have no conflict of interest to disclose.

Author Contributions:

  • Conceptualization: Choi CM.

  • Data curation: Oh IJ.

  • Formal analysis: Jung YJ, Oh IJ.

  • Investigation: Kim WS, Choi CM.

  • Methodology: Jung JH, Kim Y, Seok M, Lee W.

  • Software: Kim Y, Jung JH.

  • Validation: Park CK, Lim JH, Kim YC.

  • Writing - original draft: Jung YJ.

  • Writing - review & editing: Choi CM.

References

1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2016. CA Cancer J Clin. 2016; 66(1):7–30. PMID: 26742998.
crossref
2. Jung KW, Won YJ, Kong HJ, Oh CM, Lee DH, Lee JS. Cancer statistics in Korea: incidence, mortality, survival, and prevalence in 2011. Cancer Res Treat. 2014; 46(2):109–123. PMID: 24851102.
crossref
3. National Lung Screening Trial Research Team. Aberle DR, Adams AM, Berg CD, Black WC, Clapp JD, et al. Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med. 2011; 365(5):395–409. PMID: 21714641.
crossref
4. National Lung Screening Trial Research Team. Church TR, Black WC, Aberle DR, Berg CD, Clingan KL, et al. Results of initial low-dose computed tomographic screening for lung cancer. N Engl J Med. 2013; 368(21):1980–1991. PMID: 23697514.
crossref
5. Moyer VA. U.S. Preventive Services Task Force. Screening for lung cancer: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med. 2014; 160(5):330–338. PMID: 24378917.
crossref
6. Birse CE, Tomic JL, Pass HI, Rom WN, Lagier RJ. Clinical validation of a blood-based classifier for diagnostic evaluation of asymptomatic individuals with pulmonary nodules. Clin Proteomics. 2017; 14(1):25. PMID: 28694742.
crossref
7. Brody EN, Gold L. Aptamers as therapeutic and diagnostic agents. J Biotechnol. 2000; 74(1):5–13. PMID: 10943568.
crossref
8. Kanwar JR, Roy K, Maremanda NG, Subramanian K, Veedu RN, Bawa R, et al. Nucleic acid-based aptamers: applications, development and clinical trials. Curr Med Chem. 2015; 22(21):2539–2557. PMID: 25723512.
crossref
9. Yüce M, Ullah N, Budak H. Trends in aptamer selection methods and applications. Analyst (Lond). 2015; 140(16):5379–5399. PMID: 26114391.
crossref
10. Gold L, Ayers D, Bertino J, Bock C, Bock A, Brody EN, et al. Aptamer-based multiplexed proteomic technology for biomarker discovery. PLoS One. 2010; 5(12):e15004. PMID: 21165148.
11. Ostroff RM, Bigbee WL, Franklin W, Gold L, Mehan M, Miller YE, et al. Unlocking biomarker discovery: large scale application of aptamer proteomic technology for early detection of lung cancer. PLoS One. 2010; 5(12):e15003. PMID: 21170350.
crossref
12. Mehan MR, Williams SA, Siegfried JM, Bigbee WL, Weissfeld JL, Wilson DO, et al. Validation of a blood protein signature for non-small cell lung cancer. Clin Proteomics. 2014; 11(1):32. PMID: 25114662.
crossref
13. Jung YJ, Katilius E, Ostroff RM, Kim Y, Seok M, Lee S, et al. Development of a protein biomarker panel to detect non-small-cell lung cancer in Korea. Clin Lung Cancer. 2017; 18(2):e99–e107. PMID: 27836219.
crossref
14. Chong S, Lee KS, Chung MJ, Kim TS, Kim H, Kwon OJ, et al. Lung cancer screening with low-dose helical CT in Korea: experiences at the Samsung Medical Center. J Korean Med Sci. 2005; 20(3):402–408. PMID: 15953860.
crossref
15. Detterbeck FC, Mazzone PJ, Naidich DP, Bach PB. Screening for lung cancer: diagnosis and management of lung cancer, 3rd ed: American College of Chest Physicians evidence-based clinical practice guidelines. Chest. 2013; 143(5 Suppl):e78S–e92S. PMID: 23649455.
16. Smith MA, Battafarano RJ, Meyers BF, Zoole JB, Cooper JD, Patterson GA. Prevalence of benign disease in patients undergoing resection for suspected lung cancer. Ann Thorac Surg. 2006; 81(5):1824–1828. PMID: 16631679.
crossref
17. Li XJ, Hayward C, Fong PY, Dominguez M, Hunsucker SW, Lee LW, et al. A blood-based proteomic classifier for the molecular characterization of pulmonary nodules. Sci Transl Med. 2013; 5(207):207ra142.
crossref
18. Chapman CJ, Healey GF, Murray A, Boyle P, Robertson C, Peek LJ, et al. EarlyCDT®-Lung test: improved clinical utility through additional autoantibody assays. Tumour Biol. 2012; 33(5):1319–1326. PMID: 22492236.
crossref
19. Pinsky PF, Church TR, Izmirlian G, Kramer BS. The National Lung Screening Trial: results stratified by demographics, smoking history, and lung cancer histology. Cancer. 2013; 119(22):3976–3983. PMID: 24037918.
crossref
20. American College of Radiology. Lung CT screening reporting & data system (Lung-RADS). Updated 2014. Accessed July 31, 2014. http://www.acr.org/Quality-Safety/Resources/LungRADS.
Fig. 1

Flow sheet of enrollment.

NSCLC = non-small cell lung cancer.
jkms-33-e342-g001
Fig. 2

Diagnostic performance of AptoDetect™-Lung. (A) AUC according to NSCLC stage, (B) AUC according to NSCLC histology, (C) AUC in high-risk population.

AUC = area under the curve, NSCLC = non-small cell lung cancer.
aHigh-risk population corresponds to more than 55 years of age and a smoking history of 30 pack-years.
jkms-33-e342-g002
Table 1

Demographic and baseline characteristics

jkms-33-e342-i001
Characteristics NSCLC Benign nodule P value
Subjects 200 200 -
Median age, median (range), yr 65 (27–79) 56 (21–76) < 0.001
Average age, mean ± SD, yr 63.76 ± 9.37 56.46 ± 7.23 < 0.001
Gender
Men 154 (77) 148 (74) 0.485
Women 46 (23) 52 (26) -
Smoking history 199a 200 0.056
Never smoker 56 (28.0) 79 (39.5)
Former smoker 79 (39.5) 68 (33.5)
Current smoker 64 (32.0) 53 (26.5)
Pack-year, median (range) 38.0 (1.0–129.0) 27.0 (1.0–86.0) 0.370
Pack-year, mean ± SD 38.12 ± 24.93 30.48 ± 17.29 0.016
Histopathology
Squamous cell carcinoma 94 (47) - -
Adenocarcinoma 106 (53) - -
Stage
I 48 (24) - -
II 34 (17) - -
III 44 (22) - -
IV 74 (37) - -
Nodule size, median (range), mm 37.0 (7–101.0) 5.0 (2–60.0) < 0.001
Nodule size, mean ± SD, mm 41.65 ± 19.53 7.03 ± 8.18 < 0.001
The presence of spiculation 59 (29.5) 10 (5) < 0.001
Values are presented as number (%).
NSCLC = non-small cell lung cancer, SD = standard deviation.
aSmoking history for one patient was uncertain.
TOOLS
ORCID iDs

Young Ju Jung
https://orcid.org/0000-0001-7510-4531

In-Jae Oh
https://orcid.org/0000-0003-4837-1321

Youndong Kim
https://orcid.org/0000-0001-8258-8810

Jong Ha Jung
https://orcid.org/0000-0002-5604-3435

Minkyoung Seok
https://orcid.org/0000-0002-5309-9679

Woochang Lee
https://orcid.org/0000-0003-3956-6397

Cheol Kyu Park
https://orcid.org/0000-0001-8701-0786

Jung-Hwan Lim
https://orcid.org/0000-0003-0039-0662

Young-Chul Kim
https://orcid.org/0000-0001-7019-7687

Woo-Sung Kim
https://orcid.org/0000-0002-1254-1264

Chang-Min Choi
https://orcid.org/0000-0002-2881-4669

Similar articles