Abstract
Objectives
The importance of the prediction of coronary heart disease (CHD) has been recognized in Korea; however, few studies have been conducted in this area. Therefore, it is necessary to develop a method for the prediction and classification of CHD in Koreans.
Methods
A model for CHD prediction must be designed according to rule-based guidelines. In this study, a fuzzy logic and decision tree (classification and regression tree [CART])-driven CHD prediction model was developed for Koreans. Datasets derived from the Korean National Health and Nutrition Examination Survey VI (KNHANES-VI) were utilized to generate the proposed model.
Coronary heart disease (CHD) has the highest mortality rate of all the non-communicable diseases throughout the world. Therefore, the prediction of CHD is necessary for reducing the management costs of CHD and for promoting health [1]. CHD is very dangerous because it is directly related to the patient's lifestyle; hence, prevention is important [2]. The two standard datasets used to predict the CHD risk level are the Framingham risk score (FRS) and prospective cardiovascular Münster (PROCAM) [3]. However, FRS and PROCAM are not tailored for Koreans; therefore, the accuracy of heart risk prediction using these methods is low when applied to Koreans [45].
Thus far, many previous studies have proposed methods to predict CHD using data mining, artificial intelligence, and machine learning techniques [67]. CHD prediction models based on data mining use various algorithms, such as artificial neural networks, decision trees, Bayesian theory, and genetic algorithms [8]. Anooj [9] proposed the generation of a fuzzy rule based on rule induction using decision trees to develop a clinical decision support system (CDSS) and predict the risk level. Khatibi and Montazer [10] developed a CHD risk prediction model based on the Dempster-Shafer evidence theory by designing a fuzzy-evidential hybrid inference engine using the FRS and PROCAM guidelines. Krishnaiah et al. [11] developed a CHD prediction system using a fuzzy K-NN classifier for measured values to remove uncertainty. CHD prediction models have been extended to a health management service model and a CDSS [12]. However, few studies have investigated the prediction of CHD in Koreans, which is an important requirement [5].
Therefore, it is necessary to develop a CHD prediction model for Koreans using data mining. In Korea, few studies have aimed to produce guidelines for CHD prediction thus far. Thus, rules based on guidelines are required, which should be produced using a data mining technique [13]. Certain biometric information related to CHD is also uncertain, so a solution is required to address this problem; fuzzy logic may reduce the uncertainty of medical informatics [14]. Additionally, the FRS guidelines, which have been used as a predictive model, are not appropriate for Koreans. Therefore, a new prediction model should be produced based on local clinical data to predict CHD in Koreans using decision tree rule induction [15].
In this study, the model was developed data mining-driven CHD prediction model using fuzzy logic and decision-tree. Datasets derived from the Korean National Health and Nutrition Examination Survey VI (KNHANES-VI) were utilized to produce the proposed model [16]. Furthermore, rules were generated using the classification and regression tree (CART) of the decision tree technique [17], whereas a fuzzy logic approach was employed to address the uncertainty problem, which allowed CHD to be predicted.
The FRS, PROCAM, and Adult Treatment Panel III (ATP III) datasets have been used as standard guidelines for predicting CHD and CHD risk factors for the last 10 years. Therefore, the factors stated in these guidelines were used as a reference for data extraction.
Clinical data were acquired from KNHANES-VI, which was a survey study conducted by the Korea Centers for Disease Control and Prevention. KNHANES provides a basis for policy establishment and the evaluation of the comprehensive national health promotion plan. It contains data on the health and nutritional status of Koreans based on national statistics collected by the Korea Centers for Disease Control and Prevention [16].
Table 1 shows the extracted dataset. There were nine input variables and one output variable. Input variables are the important factors that are widely used for the prediction of CHD, namely, age, sex total cholesterol, low-density lipoprotein (LDL), high-density lipoprotein (HDL), systolic blood pressure, diastolic blood pressure, smoking, and diabetes [3]. The output variables are CHD risk factors that have preprocessing the output variables (hypertension, hyperlipidemia, myocardial infarction, and angina pectoris). If subjects have more than one of these diseases, they are defined as having CHD (low risk and high risk).
The experimental subjects were 8,108 survey subjects from KNHANES-VI. There were 8,108 survey subjects in total, and the exclusions were 7,329 uncertain respondents, 31 people aged less than 20 years. The final dataset comprised 748 subjects. Figure 1 illustrates the data selection process.
A classification model and a process for dealing with uncertain data are required to predict CHD. The process of the CHD prediction model is shown in Figure 2.
The prediction model is a fuzzy-logic-based inference method that requires a rule base and fuzzy membership functions. Rule induction was performed using the KNHANES dataset to generate the rules. The rule induction technique generated rules using the decision tree method. After that, the generated rules were transformed for using in the fuzzy inference engine. [18]. FRS and case studies with existing fuzzy functions were considered before the fuzzy membership functions were created [910]. Finally, the fuzzy membership functions were produced after the model was validated. The CHD risk level of a subject could be inferred using the rules generated by the decision tree and the fuzzy-logic-based classification prediction model.
Formal rules were extracted from the continuous dataset of observations by rule induction. In this study, a decision tree technique was used to generate the rules. CART is known to be a useful approach for pruning leaf nodes, which enhances the generalization capability of learned trees when the generated trees have an excessive number of steps and leaf nodes. CART can also perform analyses and interpretations to generate propositional knowledge, which is a set of rules used to generate 'If-Then' rules. Therefore, a CHD prediction model for Koreans was produced by applying the CART rule induction algorithm to KNHANES-VI.
Fuzzy logic is a multi-valued logic that is useful for solving uncertainty problems, and it can address the degree of membership and degrees of truth. CHD-related data contains considerable uncertainty; hence, the data is inferred using fuzzy logic. Figure 3 shows the fuzzy inference model used by the CHD classification prediction model.
The fuzzy inference model determines the CHD risk level by inference using the heart-disease-related input data. The continuous dataset and categorical dataset were used as the input data. The input continuous dataset comprised the age, total cholesterol, LDL cholesterol, HDL cholesterol, systolic blood pressure, and diastolic blood pressure. The uncertainty of the continuous data was inferred by fuzzifying using the fuzzifier. The fuzzifier acquired the data via the fuzzy membership function. Figure 4 shows the fuzzy membership function. Six of the continuous input variables were fuzzified and the output variable was the CHD risk level.
The categorical dataset contained Boolean logic data types, such as sex, smoking, and diabetes; hence, the fuzzy membership function was not required. After the fuzzified functions and categorical data had been input, the fuzzy inference engine performed inference using the rules. The Mamdani max-min approach was used as the inference mechanism, while defuzzification used the center of gravity (COG) method to display the final output.
The proposed CHD risk prediction model was implemented and evaluated. Figure 5 shows the experimental scenario tested. The final data from the KNHANES dataset (748 / 8,108 subjects) were categorized into a training set and a test set. The training set contained 525 subjects (70%), and it was used to create the rule induction and fuzzy membership functions as well as the classification prediction model. The test set contained 223 subjects (30%), and it was used to verify the proposed model.
IBM SPSS modeler 14.2 was used for rule induction. CART was also used for rule induction where the pruning severity was 75%, the minimum records per child branch was two, the boosting number was restricted to 10 for individual options, and the highest probability rule model was used. MATLAB R2009b with a fuzzy tool box was used to produce the fuzzy inference model. A confusion matrix was used to evaluate the predictive model [19]. Table 2 shows the confusion matrix.
The true positive (TP) value was the number of cases that correctly predicted CHD patients and the true negative (TN) value was the number of cases that correctly predicted healthy subjects as non-heart-disease patients. The false positive (FP) value was the number of cases that identified a patient as healthy who had CHD, and the false negative (FN) value was the number of cases that predicted that a patient had CHD who was healthy.
Our model was compared with previous results using an artificial neural network (ANN) [20], support vector machine (SVM) [21], logistics regression (LR) [22], and decision tree C5.0 [23] to evaluate the performance. Finally, it was compared with propose model. The confusion matrix and ROC curve results are shown in Tables 3 and 4, respectively.
The experimental results showed that the ANN, LR, and SVM had relatively high accuracy rates of 62.78%, 63.23%, and 67.71%, respectively, although they were lower than that of the proposed model because ANN and SVM only made observations at the learning level. C5.0, which are decision tree-based methods, yielded accuracy scores of 53.36%. The proposed model had accuracy and sensitive scores of 69.51% and 93.10%, respectively, which were higher than those of the other models. The higher accuracy and sensitivity of the proposed model can be attributed to the reduction of uncertainty achieve by using fuzzy logic. CART, which was used for rule induction, cannot process uncertainty adequately. The propose model performs better than ANN and SVM in terms of accuracy and sensitive is the highest reason, ANN and SVM learning and resoning about the complex relationship between the each training data; however, ANN and SVM do not resolve the problem of uncertainy. However, the propose model overcomes the problem of the uncertainty of the data by using fuzzy logic. However, specificity of proposed model is lower than that of the other models. Thus, future studies are required to develop a prediction model with higher specificity. The ROC curve result of the proposed model (0.594) was higher than that of the other models, and this can help in the decision support of the prediction of CHD.
This paper proposed a novel predictive model for CHD based on data derived from KNHANES-VI, which were collected by the Korea Centers for Disease Control and Prevention. The propose model decision supports the prediction of CHD by utilizing fuzzy logic and CART-based rule induction. Rule induction was performed using the KNHANES-VI datasets to generate the rules using the CART method. The prediction model used an inference model based on fuzzy logic. The rules were generated using a CART decision tree method, and fuzzy membership functions were created based on those used in previous case studies and FRS. A final dataset containing 748 subjects was selected from KNHANES-VI and used for the performance evaluation. The experimental results showed that the proposed model improved the prediction accuracy and sensitivity. Using the propose model is expected to offer decision support for CHD prediction.
Future research should focus on developing data mining based prediction methods that may also increase the accuracy and specificity of CHD prediction.
Figures and Tables
Table 3
ANN: artificial neural network, SVM: support vector machine, LR: logistics regression, PPV: postivie prediction value, NPV: negative prediction value, TP: true positivie, TN: true negative, FP: false positive, FN: false negative.
Accuracy = (TP + TN) / (TP + TN + FP + FN)
Sensitivity = TP / (TP + FN)
Specificity = TN / (FP + TN)
PPV = TP / (TP + FP)
NPV = TN / (TN + FN)
Acknowledgments
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. NRF-2013 M3C8A2A02078403).
References
1. World Health Organization. The world health report 2010 [Internet]. Geneva, Switzerland: World Health Organization;c2015. cited at 2015 Jul 1. Available from: http://www.who.int/whr/2010/en/.
2. Liu K, Daviglus ML, Loria CM, Colangelo LA, Spring B, Moller AC, et al. Healthy lifestyle through young adulthood and the presence of low cardiovascular disease risk profile in middle age: the Coronary Artery Risk Development in (Young) Adults (CARDIA) study. Circulation. 2012; 125(8):996–1004.
3. Wilson PW, D'Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB. Prediction of coronary heart disease using risk factor categories. Circulation. 1998; 97(18):1837–1847.
4. Lee DY, Rhee EJ, Choi ES, Kim JH, Won JC, Park CY, et al. Comparison of the predictability of cardiovascular disease risk according to different metabolic syndrome criteria of American Heart Association/National Heart, Lung, and Blood Institute and International Diabetes Federation in Korean men. Korean Diabetes J. 2008; 32(4):317–327.
5. Kim JK, Lee JS, Park DK, Lim YS, Lee YH, Jung EY. Adaptive mining prediction model for content recommendation to coronary heart disease patients. Cluster Comput. 2014; 17(3):881–891.
6. Song MH, Kim SH, Park DK, Lee YH. A multi-classifier based guideline sentence classification system. Healthc Inform Res. 2011; 17(4):224–231.
7. Hachesu PR, Ahmadi M, Alizadeh S, Sadoughi F. Use of data mining techniques to determine and predict length of stay of cardiac patients. Healthc Inform Res. 2013; 19(2):121–129.
8. Palaniappan S, Awang R. Intelligent heart disease prediction system using data mining techniques. In : Proceedings of IEEE/ACS International Conference on Computer Systems and Applications (AICCSA2008); 2008 Mar 31-Apr 4; Doha, Qatar. p. 108–115.
9. Anooj PK. Clinical decision support system: risk level prediction of heart disease using decision tree fuzzy rules. Int J Res Rev Comput Sci. 2012; 3(3):1659–1667.
10. Khatibi V, Montazer GA. A fuzzy-evidential hybrid inference engine for coronary heart disease risk assessment. Expert Syst Appl. 2010; 37(12):8536–8542.
11. Krishnaiah V, Narsimha G, Chandra NS. Heart disease prediction system using data mining technique by fuzzy K-NN approach. In : Satapathy SC, Govardhan A, Srujan Raju K, Mandal JK, editors. Emerging ICT for bridging the future: Proceedings of the 49th Annual Convention of the Computer Society of India (CSI). Cham, Switzerland: Springer International Publishing;2015. p. 371–384.
12. Jung H, Yang J, Woo JI, Lee BM, Ouyang J, Chung K, Lee Y. Evolutionary rule decision using similarity based associative chronic disease patients. Cluster Comput. 2014; 18(1):279–291.
13. Barman M, Choudhury JP. A fuzzy rule base system for the diagnosis of heart disease. Int J Comput Appl. 2012; 57(7):46–53.
14. Papageorgiou EI. A new methodology for decisions in medical informatics using fuzzy cognitive maps based on fuzzy rule-extraction techniques. Appl Soft Comput. 2011; 11(1):500–513.
15. Kim JK, Son EJ, Lee YH, Park DK. Decision tree driven rule induction for heart disease prediction model: Korean National Health and Nutrition Examinations Survey V-1. In : Kim KJ, Chung KY, editors. IT Convergence and Security 2012. Amsterdam: Springer Netherlands;2013. p. 1015–1020.
16. Korea Center for Disease Control and Prevention. The 6th Korea National Health & Nutrition Examination Survey 2013 (KNHANES VI) [Internet]. Cheongju: Korea Center for Disease Control and Prevention;c2015. cited 2015 Jul 1. Available from: http://knhanes.cdc.go.kr/.
17. Park M, Kim H, Kim SK. Knowledge discovery in a community data set: malnutrition among the elderly. Healthc Inform Res. 2014; 20(1):30–38.
18. Son EJ, Kim JK, Lee YH, Jung EY. Data Mining-Driven Chronic Heart Disease for Clinical Decision Support System Architecture in Korea. In : Kim KJ, Chung KY, editors. IT Convergence and Security 2012. Amsterdam: Springer Netherlands;2013. p. 1021–1025.
19. Zhu W, Zeng N, Wang N. Sensitivity, specificity, accuracy, associated confidence interval and ROC analysis with practical SAS implementations. In : Proceedings of Northeast SAS Users Group (NESUG) 2010: Health
Care and Life Sciences; 2010 Nov 14-17; Baltimore, MD. p. 1–9.
20. Akay M. Noninvasive diagnosis of coronary artery disease using a neural network algorithm. Biol Cybern. 1992; 67(4):361–367.
21. Sengur A. Support vector machine ensembles for intelligent diagnosis of valvular heart disease. J Med Syst. 2012; 36(4):2649–2655.
22. Laurent S, Boutouyrie P, Asmar R, Gautier I, Laloux B, Guize L, et al. Aortic stiffness is an independent predictor of all-cause and cardiovascular mortality in hypertensive patients. Hypertension. 2001; 37(5):1236–1241.
23. Freund Y, Mason L. The alternating decision tree learning algorithm. In : Proceedings of the 16th International Conference on Machine Learning (ICML'99); 1999 Jun 27-30; Bled, Slovenia. p. 124–133.