Journal List > Ann Surg Treat Res > v.99(2) > 1149399

Liang, Chen, Luo, Chen, Gu, Xu, Dang, Qin, Lu, Huang, Huang, Gao, and Chen: Nomogram for predicting overall survival in children with neuroblastoma based on SEER database

Abstract

Purpose

This study was performed to establish and validate a nomogram for predicting the overall survival in children with neuroblastoma.

Methods

The latest clinical data of neuroblastoma in Surveillance, Epidemiology, and End Results (SEER) database was extracted from 2000 to 2016. The cases included were randomly divided into training and validation cohorts. The survival curves were drawn with a Kaplan-Meier estimator to investigate the influences of certain single factors on overall survival. Also, least absolute shrinkage and selection operator regression was applied to further select the prognostic variables for neuroblastoma. Additionally, receiver operating characteristic (ROC) curves and calibration curves were used to evaluate the accuracy of the nomogram.

Results

In total, 1,262 patients were collected and 8 independent prognostic factors were achieved, including patients' age, sex, race, tumor grade, radiotherapy, chemotherapy, tumor site, and tumor size. Then we constructed a nomogram by using the data of the training cohort with 886 cases. Subsequently, the nomogram was validated internally and externally with 886 and 376 cases, respectively. The internal validation revealed that the area under the curves (AUC) of ROC curves of 1-, 3-, and 5-year overall survival were 0.69, 0.78, and 0.81, respectively. Accordingly, the external validation also showed that the AUC of 1-, 3-, and 5-year overall survival were all ≥0.69. Both methods of validation demonstrated that the predictive calibration curves were consistent with standard curves.

Conclusion

The nomogram possess the potential to be a new tool in predicting the survival rate of neuroblastoma patients.

INTRODUCTION

Neuroblastoma (NB) stem from the adrenal glands [1] and appear as a type of extracranial solid tumors occurring in children, which constitute 15% of child deaths from cancers [23], with the incidence rate being 1/7,000–1/8,000. Multimodal therapy currently seems an effective treatment for NB, which includes operation, chemotherapy, radiotherapy and immunotherapy [45678]. Generally, children with low-risk NB have a good prognosis and seldom need intensified therapy [91011], while patients with high-risk NB are diagnosed with obvious tumor progression, showing a bad prognosis, with the long-term survival rate being 50% [1213].
Contemporarily, there are 2 major staging systems of NB—International Neuroblastoma Risk Group Staging System (INRGSS) and International Neuroblastoma Staging System (INSS). According to INRGSS put into effect in 2008, NB was classified into 4 risk groups; very low risk, low risk, intermediate risk, or high risk, based on age (months), histologic category, grade of tumor, differentiation, MYCN, 11q aberration and ploidy [141516]. INSS, used previously [17], was mainly based on the surgical treatment, not taking other factors into account. However, INRGSS and INSS were both applied solely in determining the intensity of the treatment, though they failed to assist in predicting the overall survival individually.
Fortunately, a nomogram was proposed as a predictive modelling by means of multivariate regression analysis, and it was widely accepted owing to its accuracy, objectivity, and visualization [18192021]. Due to its excellent performance in forecast, the nomogram was admitted into the National Comprehensive Cancer Network guideline [22]. Currently, the existing predictive models of survival rate of patients with NB worked on the expression of certain gene or protein [23], and statistics regarding the expression were hard to attain and costly. As we were preparing this paper, a study based on the therapeutically applicable research to generate effective treatment (TARGET) database reported a nomogram for the prognosis prediction of NB [24]. However, this study only included 3 independent prognostic factors of age, INSS, and ploidy. Consequently, we researchers took advantage of the common and easy-to-get clinicopathologic data in the Surveillance, Epidemiology, and End Results (SEER) database, constructing the predictive modelling of NB and then assessing its validity and accuracy via internal and external validation.

METHODS

Patients

In this study, the latest clinical data of NB in SEER database was extracted with the publication time ranging from 2000 to 2016. The pathological type we searched for was adolescents and young adults (AYA) site recode/WHO 2008 definition: 9.1.2 Neuroblastoma.
Exclusion standards was (1) patients were over 20 years-old; (2) the clinical data of patients were not recorded (including race, survival period, staging, or tumor size); (3) patients had less-than-one-month survival period. The study had been approved by the Institutional Review Board of The First Affiliated Hospital of Guangxi Medical University (approval number: 2018 (KY-E-104)). The informed consent from the subjects was exempted. The registration number we used to acquire clinical data from the SEER database was 12080-Nov2018. The cases included were randomly divided into training (70.2%) and validation cohorts (29.8%).

Variables

The variables selected for the research involved survival condition, survival time, age, sex, race, grade, radiotherapy, chemotherapy, tumor size, and tumor site. The age item consisted of two cohorts; <2 years old and 2–20 years old, which was built on INRGSS and INSS [12]. Eighteen months was used as a grading standard. The age of 2 years old was determined as a cutoff point. Races included whites, blacks, and others (American Indian/Alaskan Native, Asian/Pacific Islander). There were 4 grading levels: well differentiated (grade I); moderately differentiated (grade II); poorly differentiated (grade III); undifferentiated, anaplastic (grade IV). Tumor sites included A (adrenal gland), B (soft tissue including heart), C (retroperitoneum), D (mediastinum and other respiratory organs), and E (other). Tumor size was measured as <5 cm, 5.1–10 cm, 10.1–15 cm, and >15 cm.

Statistical analyses

The survival curves were drawn with a Kaplan-Meier estimator to investigate the influences of certain single factors on overall survival. Also, least absolute shrinkage and selection operator (LASSO) regression was applied to further select the prognostic variables for NB. LASSO regression was perceived as a well-performed method for variable selection, as it could preclude overfitting and include the optimal predictive factors into modelling [2526]. Having selected the variables, we began to construct the nomogram by Cox model to estimate the 1-, 3-, and 5-year overall survival rates. Additionally, receiver operating characteristic (ROC) curves were drawn to evaluate the predictive accuracy and calibration curves were used to determine whether the average survival rate was consistent with the predicted one. The differentiation was statistically significant if P < 0.05.
The statistical analysis was carried out with R ver. 3.6.0 (R Foundation for Statistical Computing, Vienna, Austria; http://www.r-project.org), which included foreign, survival, glmnet, caret, rms, timeROC packages [27].

RESULTS

Clinicopathological features

A total of 3,264 patients were extracted from the SEER database. We selected the data by the exclusion standards, and the specific selection process was shown in Fig. 1. Eventually, 1,262 patients were collected for the current research (Table 1). It was revealed that patients under 2 years represented the largest proportion, at 60.1% (758 patients). The older the children grow, the slighter the chance of suffering from NB is. Among these patients, males (695, 55.1%) outnumbered females. In terms of race, the number of whites (77.3%) was considerably higher than that of blacks (13.6%) and other races (9.0%). With respect to the grading, patients of grade III comprised the greatest percentage at 78.6%. Of these cases, 72.5% had received chemotherapy, while 26.9% had been treated with radiotherapy. The tumor size was mainly <5 cm or 5.1–10 cm, with these 2 cohorts accounting for 32.8% and 44.1%, respectively. Tumor site is mainly concentrated in the adrenal gland and soft tissue including heart, accounting for 52.9% and 23.2%, respectively.

Variable selection

Kaplan-Meier survival analyses were conducted on the age, sex, race, tumor grade, radiotherapy, chemotherapy, tumor site, and tumor size. The findings showed that all these factors except sex (P = 0.311) exerted substantial impacts on survival time, with P < 0.05 (Fig. 2). In addition, patients under the age of 2 years had a noticeably higher overall survival rate than those from 2–20 years of age. Moreover, the overall rate of the whites was higher than that of the blacks or other races. Furthermore, the influence of sex seemed minimal. Also, patients at grade III or IV had remarkably lower overall survival, compared with those at grade I or II. Furthermore, radiotherapy and chemotherapy were related with lower overall survival rate. Finally, smaller tumor size boded well for survival and prognosis. We employed LASSO regression for further selection of prognostic variables, with each curve representing the changes of an independent variable. As the log (λ) increased, the 8 variables (nonzero coefficient) of minimum criteria (the left dotted line) included age, sex, race, tumor grade, radiotherapy, chemotherapy, tumor site, and tumor size (Fig. 3).

Construction and validation of nomogram

These 1,262 patients were randomly divided into training cohort (n = 886, 70.2%) and validation cohort (n = 376, 29.8%) (Table 1). Based on the 8 independent prognostic variables (including age, sex, race, tumor grade, radiotherapy, chemotherapy, tumor site, and tumor size), we constructed nomogram for prognosis of NB by using the data of training cohort (Table 2, Fig. 4). On the left were the names of variables, and each had a corresponding score on the top. The total scores of all the variables were used to estimate the 1-, 3- and 5-year overall survival. The nomogram indicated that grades III and IV played a vital role in prognosis. The scores of these variables and the corresponding survival rate were illustrated in Table 3. More specifically, the data downloaded showed that a 3-year-old white girl, diagnosed at Grade III, had no radiotherapy treatment but underwent chemotherapy, with tumor site in the adrenal gland, and tumor size being 13 cm. The total score for this patient was 262, which was calculated by adding the score of each variable (61 + 9 + 11 + 7 + 0 + 100 + 22 + 52 = 262). Thereby, the 1-, 3-, and 5-year survival rates of this patient were more than 90%, 70%, and 62%, respectively (Fig. 4B).
Subsequently, the nomogram was validated internally and externally. The internal validation revealed that the area under the curves (AUCs) of ROC curves of 1-, 3-, and 5-year overall survival were 0.69, 0.78, and 0.81, respectively (Fig. 5). Accordingly, the external validation showed that the AUCs of ROC curves of 1-, 3-, and 5-year overall survival were 0.69, 0.75, and 0.79, respectively. Both methods of validation demonstrated that the predictive calibration curves were consistent with standard curves, particularly in the aspect of 5-year survival rate (Fig. 6).

DISCUSSION

By mining the SEER database, we, for the first time, established and validated a nomogram that could facilitate a survival rate prediction for patients with NB. This predictive modelling involved 8 prognostic factors; age, sex, race, grade, radiotherapy, chemotherapy, tumor site, and tumor size. This nomogram could be applied to forecast 1-, 3- and 5-year survival rates for patients with NB under the age of 20 years. Additionally, ROC curves were combined with calibration curves to assess the accuracy of the predictive modelling in cohorts of training and validation. Surprisingly, AUCs of ROC curves were greater than or equal to 0.69 (Fig. 5). The calibration curves suggested that a prediction by nomogram was in accordance with the observation (Fig. 6). All these results confirmed that the nomogram had considerable prognostic potential, which was validated internally and externally. Equally important, doctors and patients could make use of it to calculate the overall survival rate, which would better the treatment and follow-up plans.
In our research, the nomogram indicated that grade remained an essential predictive factor, the score increasing with the escalating grade. This was consistent with results by Pinto et al. [12], Cohn et al. [16], and London et al. [28]. In addition, patients who needed radiotherapy and chemotherapy had higher scores, which was partly because these patients had high-grade tumor or larger tumor size, or because radiotherapy and chemotherapy would produce adverse effects [4629]. In terms of race, the number of whites (77.3%) was considerably higher than that of blacks (13.6%) and other races (9.0%) (Table 1). Thus, the influences of race on survival prognosis could be better determined if we could include more data regarding race.
Basically, the novel predictive nomogram integrated with multiple variables including age, sex, race, tumor grade, radiotherapy, chemotherapy, tumor site, and tumor size from SEER possess the potential to be a new tool in predicting the survival rate of NB patients. The nomogram we made had the following advantages. First, there were a large number of patients involved in the modelling, which could reduce the differentiations among hospitals. Second, no expensive or hard-to-get factors were included. The modelling was constructed on common clinical statistics (age, sex, race, grade, radiotherapy, chemotherapy, tumor site, and tumor size), which could make the model easy to use and acceptable to other doctors and patients. Third, the nomogram could accurately predict 1-, 3-, and 5-year overall survival of patients with NB.
However, there were some limitations in our research. For a start, it was a retrospective study, and some cases were removed due to incomplete data. Additionally, the modelling solely entailed some common clinical data, which was devoid of MYCN genes, chromosome ploidy, grading data concerning INSS and INRGSS. Therefore, we could hardly estimate the influences of these lacking factors on the prognosis, which explains why the AUC values were moderate in our research. Furthermore, all these cases were collected in the United States alone, which failed to represent the treatment and prognosis of patients with NB in other parts of the world. To improve our research, we intend to cooperate with large hospitals to collect the clinicopathological information of patients with NB. Furthermore, a revised modelling should include molecular factors like MYCN genes, chromosome ploidy, and so forth.
For the first time, we researchers established and validated a predictive modelling of NB—nomogram, based on the data collected from SEER. Doctors and patients could take advantage of the modelling to acquire an accurate prognosis, which could help doctors work out better diagnosis, treatment, and follow-up plans.

Notes

Fund/Grant Support: We gratefully acknowledge the SEER database for allowing open access to the clinical data. This study was supported by Guangxi Natural Science Foundation Program (grant number 2014GXNSFAA118202) and Self-financing Scientific Research Project of Guangxi Zhuang Autonomous Region (grant number GZZC2019037).

Conflict of Interest: No potential conflict of interest relevant to this article was reported.

Author Contribution:

  • Conceptualization: GC, JBC, LG.

  • Formal Analysis: SWL, PC, WTH.

  • Investigation: SWL, JHG, ZGH.

  • Methodology: YGL, LTQ, HPL.

  • Project Administration: QQX, YWD.

  • Writing – Original Draft: SWL.

  • Writing – Review & Editing: JBC, GC, YGL.

References

1. Jubierre L, Jiménez C, Rovira E, Soriano A, Sábado C, Gros L, et al. Targeting of epigenetic regulators in neuroblastoma. Exp Mol Med. 2018; 50:51. PMID: 29700278.
2. Rickman DS, Schulte JH, Eilers M. The expanding world of N-MYC-driven tumors. Cancer Discov. 2018; 8:150–163. PMID: 29358508.
3. Meena JP, Gupta AK. Neuroblastoma in a developing country: miles to go. Indian J Pediatr. 2019; 86:403–405. PMID: 30915646.
4. Zareifar S, Shakibazad N, Zekavat OR, Bordbar M, Shahriari M. Successful treatment of refractory metastatic neuroblastoma with panobinostat in combination with chemotherapy agents and iodine-131-meta-iodobenzylguanidine therapy. J Oncol Pharm Pract. 2020; 26:481–486. PMID: 31156056.
5. Herd F, Basta NO, McNally RJQ, Tweddle DA. A systematic review of re-induction chemotherapy for children with relapsed high-risk neuroblastoma. Eur J Cancer. 2019; 111:50–58. PMID: 30822684.
6. Swift CC, Eklund MJ, Kraveka JM, Alazraki AL. Updates in diagnosis, management, and treatment of neuroblastoma. Radiographics. 2018; 38:566–580. PMID: 29528815.
7. PDQ Pediatric Treatment Editorial Board. Neuroblastoma Treatment (PDQ®): Health Professional Version. PDQ Cancer Information Summaries. Bethesda (MD): National Cancer Institute (US);2002.
8. Valter K, Zhivotovsky B, Gogvadze V. Cell death-based treatment of neuroblastoma. Cell Death Dis. 2018; 9:113. PMID: 29371588.
9. Pastor ER, Mousa SA. Current management of neuroblastoma and future direction. Crit Rev Oncol Hematol. 2019; 138:38–43. PMID: 31092383.
10. Han Y, Ye X, Cheng J, Zhang S, Feng W, Han Z, et al. Integrative analysis based on survival associated co-expression gene modules for predicting Neuroblastoma patients' survival time. Biol Direct. 2019; 14:4. PMID: 30760313.
11. Yao W, Li K, Dong KR, Zheng S, Xiao XM. Long-term prognosis of low-risk neuroblastoma treated by surgery alone: an experience from a single institution of China. World J Pediatr. 2019; 15:148–152. PMID: 30446974.
12. Pinto NR, Applebaum MA, Volchenboum SL, Matthay KK, London WB, Ambros PF, et al. Advances in risk classification and treatment strategies for neuroblastoma. J Clin Oncol. 2015; 33:3008–3017. PMID: 26304901.
13. Morgenstern DA, Bagatell R, Cohn SL, Hogarty MD, Maris JM, Moreno L, et al. The challenge of defining “ultra-high-risk” neuroblastoma. Pediatr Blood Cancer. 2019; 66:e27556. PMID: 30479064.
14. Park JR, Bagatell R, Cohn SL, Pearson AD, Villablanca JG, Berthold F, et al. Revisions to the international neuroblastoma response criteria: a consensus statement from the National Cancer Institute clinical trials planning meeting. J Clin Oncol. 2017; 35:2580–2587. PMID: 28471719.
15. Matthay KK, Maris JM, Schleiermacher G, Nakagawara A, Mackall CL, Diller L, et al. Neuroblastoma. Nat Rev Dis Primers. 2016; 2:16078. PMID: 27830764.
16. Cohn SL, Pearson AD, London WB, Monclair T, Ambros PF, Brodeur GM, et al. The International Neuroblastoma Risk Group (INRG) classification system: an INRG Task Force report. J Clin Oncol. 2009; 27:289–297. PMID: 19047291.
17. Brodeur GM, Pritchard J, Berthold F, Carlsen NL, Castel V, Castelberry RP, et al. Revisions of the international criteria for neuroblastoma diagnosis, staging, and response to treatment. J Clin Oncol. 1993; 11:1466–1477. PMID: 8336186.
18. Hu CY, Pan ZY, Yang J, Chu XH, Zhang J, Tao XJ, et al. Nomograms for predicting long-term overall survival and cancer-specific survival in lip squamous cell carcinoma: a population-based study. Cancer Med. 2019; 8:4032–4042. PMID: 31112373.
19. Liu G, Liu Q, Sun SR. Nomograms for estimating survival in patients with papillary thyroid cancer after surgery. Cancer Manag Res. 2019; 11:3535–3544. PMID: 31114382.
20. Huang L, Balavarca Y, van der Geest L, Lemmens V, Van Eycken L, De Schutter H, et al. Development and validation of a prognostic model to predict the prognosis of patients who underwent chemotherapy and resection of pancreatic adenocarcinoma: a large international population-based cohort study. BMC Med. 2019; 17:66. PMID: 30905320.
21. Guo CX, Shen YN, Zhang Q, Zhang XZ, Wang JL, Gao SL, et al. Prediction of postoperative pancreatic fistula using a nomogram based on the updated definition. Ann Surg Treat Res. 2020; 98:72–81. PMID: 32051815.
22. Mohler JL, Antonarakis ES, Armstrong AJ, D'Amico AV, Davis BJ, Dorff T, et al. Prostate Cancer, Version 2.2019, NCCN Clinical Practice Guidelines in Oncology. J Natl Compr Canc Netw. 2019; 17:479–505. PMID: 31085757.
23. Xie Y, Xu H, Fang F, Li Z, Zhou H, Pan J, et al. A 3-protein expression signature of neuroblastoma for outcome prediction. Am J Surg Pathol. 2018; 42:1027–1035. PMID: 29794872.
24. Li X, Meng Y. A prognostic nomogram for neuroblastoma in children. PeerJ. 2019; 7:e7316. PMID: 31338261.
25. Tibshirani R. The lasso method for variable selection in the Cox model. Stat Med. 1997; 16:385–395. PMID: 9044528.
26. Hu J, Wang T, Zhang KH, Jiang YP, Xu S, Chen SH, et al. Pretreatment risk management of a novel nomogram model for prediction of thoracoabdominal extrahepatic metastasis in primary hepatic carcinoma. J Transl Med. 2019; 17:117. PMID: 30961629.
27. Jiang Y, Wang W, Chen C, Zhang X, Zha X, Lv W, et al. Radiomics signature on computed tomography imaging: association with lymph node metastasis in patients with gastric cancer. Front Oncol. 2019; 9:340. PMID: 31106158.
28. London WB, Castel V, Monclair T, Ambros PF, Pearson AD, Cohn SL, et al. Clinical and biologic features predictive of survival after relapse of neuroblastoma: a report from the International Neuroblastoma Risk Group project. J Clin Oncol. 2011; 29:3286–3292. PMID: 21768459.
29. Louis CU, Shohet JM. Neuroblastoma: molecular pathogenesis and therapy. Annu Rev Med. 2015; 66:49–63. PMID: 25386934.
Fig. 1

The process of data selection.

astr-99-118-g001
Fig. 2

The influence of each independent predictive factor on overall survival by Kaplan-Meier survival analysis. (A–H) The survival curves of age, sex, race, radiation, grade, tumor size, tumor site, and chemotherapy, respectively. Annotation in (G): A, adrenal gland; B, soft tissue including heart; C, retroperitoneum; D, mediastinum and other respiratory organs; E, other.

astr-99-118-g002
Fig. 3

The selection of predictive factors by least absolute shrinkage and selection operator (LASSO) regression. (A) LASSO coefficient profiles of the 8 variables. Predictors were chosen according to the minimum criteria, where optimal λ resulted in 8 nonzero coefficients. (B) The left and right dotted lines stand for the minimum criteria and 1 standard error criterion, respectively.

astr-99-118-g003
Fig. 4

(A) The nomogram of neuroblastoma. (B) The scores of an example. A, adrenal gland; B, soft tissue including heart; C, retroperitoneum; D, mediastinum and other respiratory organs; E, other.

astr-99-118-g004
Fig. 5

The assessment of the predictive modelling by receiver operating characteristic curve. (A) Internal validation. (B) External validation. AUC, area under the curve.

astr-99-118-g005
Fig. 6

The diagonal lines (dotted) were standard curves, and the colored lines were calibration lines of prediction. When the calibration lines get closer to the standard lines, the nomogram would have greater prognostic potential. (A) The calibration curves of internal validation for 1- , 3- , 5-year probabilities of survival. (B) The calibration curves of external validation for 1- , 3- , 5-year probabilities of survival.

astr-99-118-g006
Table 1

Patient characteristics in the study

astr-99-118-i001

Values are presented as number (%).

a)Grade for differentiation of tumor cells: I–II, well differentiated and moderately differentiated; III, poorly differentiated; IV, undifferentiated/anaplastic. b)None, unknown, and refused. c)A, adrenal gland; B, soft tissue including heart; C, retroperitoneum; D, mediastinum and other respiratory organs; E, other.

Table 2

The numerical data (training cohort) used for developing the scores for each factor of nomogram

astr-99-118-i002

HR, hazard ratio; CI, confidence interval.

a)Grade for differentiation of tumor cells: I–II, well differentiated and moderately differentiated; III, poorly differentiated; IV, undifferentiated/anaplastic. b)None, unknown, and refused. c)A, adrenal gland; B, soft tissue including heart; C, retroperitoneum; D, mediastinum and other respiratory organs; E, other.

Table 3

Score assignment of the variables included in the nomogram

astr-99-118-i003

a)Grade for differentiation of tumor cells: I–II, well differentiated and moderately differentiated; III, poorly differentiated; IV, undifferentiated/anaplastic. b)None, unknown, and refused. c)A, adrenal gland; B, soft tissue including heart; C, retroperitoneum; D, mediastinum and other respiratory organs; E, other.

TOOLS
Similar articles