PDF
Citation
Print
INTRODUCTION
Osteoarthritis (OA), which is defined as the degeneration of joint cartilage and the underlying bone, is the most common joint disease. It can also be described by joint symptoms including pain and stiffness and/or structural pathology affecting many joint tissues [1]. It is clinically known that the knee joint is the most common site afflicted by OA despite the potential for any joint involvement [2]. Knee osteoarthritis (KOA) is the most common source of pain, disability, and functional loss in adults, consequently leading to abnormal gait patterns. As KOA seems to be much more prevalent today due to the increased life expectancy and body mass index (BMI) in modern times, early intervention is required through accurate early diagnosis of KOA [3].
There are various tools to classify KOA including radiological, arthroscopic, and functional scales [4]. The mainstay for diagnosing KOA is plain radiography and the Kellgren-Lawrence (K-L) grading system, which assigns a grade from 0 (no presence of OA) to 4 (severe OA), is the most commonly used [5].
Gait analysis systems can provide information on the biomechanical response of the human body to musculoskeletal disorders like KOA with non-invasive methods [6]. Some studies investigated the kinematic changes during the gait cycle and reported decreased knee joint motion during flexion, a decreased knee flexion angle during the stance phase, and an increased knee flexion angle at heel strike [7-10]. Others showed kinetic changes in KOA patients including a reduced internal knee extensor moment to reduce the loading on the knee joint, increased first peak knee external adduction moment, and initial contact with the ground with a more extended knee [10,11].
Previous studies on gait analysis mainly used spatiotemporal parameters such as step length and gait speed; kinematic parameters such as joint angle; and kinetic parameters such as ground reaction force and moment. In terms of the statistical techniques used in the study, conventional statistics such as a t-test or Mann-Whitney U test were used [10,12]. In statistically more precise studies, principle component analysis or multiple regression analysis were used [6,13,14].
We can obtain dynamic and segmented gait data, which is difficult to obtain through plain radiography, by gait analysis. When this is applied to a clinical trial, there is the advantage that rehabilitative interventions for the gait patterns of KOA patients can be performed together. However, a vast amount of gait data from gait analysis still remains limited for clinical use, and machine learning techniques have been introduced to compensate for this limitation and improve the classification accuracy.
Recently, there have been many attempts to classify and distinguish abnormal pathologic gait patterns via combining machine learning-based techniques with gait analysis system in the medical field [15-18]. When analyzing gait patterns through machine learning-based techniques, a machine classifier is necessary and the support vector machine (SVM) has been established as a successful technique for pattern recognition [19].
Therefore, this study aimed to present anew classification method of KOA patients using machine learning and evaluate the accuracy of classification by comparing it to conventional statistical analysis methods.
MATERIALS AND METHODS
Subjects
This study was performed on age-matched KOA patients (n=84) and normal participants (n=97). KOA was diagnosed through plain radiography and graded according to the K-L grading system. Subjects without knee pain, joint stiffness, gait problems, or a history of being diagnosed with KOA were considered normal participants. Before all subjects decided to participate in this study, the purpose and methods of the study was fully explained to them. Additionally, participants provided informed consent.
Prior to beginning the study, we asked subjects to maintain their usual lifestyle. In preparation for any problems, we contacted them over the phone during the experiment to check their condition or whether they had any health problems. When subjects visited our institution, they provided their own elementary demographic information including sex and age, and KOA patients were assessed for the severity of their disease through plain radiography. All demographic characteristics including age, height, weight, and BMI are described as the mean values in both the control and KOA groups (Table 1). Also, KOA patients were clustered into three groups according to the K-L grade of their affected limb via plain radiography: mild, as definite osteophyte and possible joint space narrowing on the anteroposterior weightbearing radiograph; moderate, as multiple osteophytes, definite joint space narrowing, sclerosis, and possible bony deformation; and severe, as large osteophytes, marked joint space narrowing, severe sclerosis and definite bony deformation. The affected limb was defined as a more symptomatic side in bilateral KOA patients and an ipsilateral side in unilateral KOA patients. This study was approved by Hanyang University Guri Hospital Institutional Review Board (No. 2016-06-014).
Gait analysis and experimental equipment
All subjects completed ten walking trials with a 10-m gait course. Gait trials were done in a quiet environment with proper speed for participants. We subdivided each gait cycle to easily understand and utilize it for research. Gait cycles were divided into the stance phase (SP) and swing phase (SW), and then, the SP into the initial double support phase (IDS), single support phase (SS), and terminal double support phase (TDS). Three-dimensional (3D) kinematic data from the hip, knee, and ankle joints were also gathered. All subjects performed all components of the experiments in the same environments and conditions.
In this study, a major piece of equipment for analyzing gait patterns was the inertial measurement unit (IMU)- based system (Human Track; RBiotech Co. Ltd., Seoul, Korea). Its main components consisted of a gyroscope, magnetic sensor, and accelerometer. For measuring angular velocity and proper acceleration, the triaxial gyroscope and accelerometer were used, respectively. We obtained information on the azimuth angle through a magnetic sensor. The 3D motion information was obtained using the gyroscope, accelerometer, and magnetic sensor in all three axes. The wearable IMU used in this study was wireless and attached to the lower abdomen, both sides of mid-thigh level, tibial shaft, and feet dorsum. According to Aminian et al. [20], gait analysis using a gyroscope was able to effectively estimate spatiotemporal parameters. In a previous study, the validity of applying the IMU system consisting of a gyroscope, accelerometer, and magnetometer to gait analysis was also verified [21]. Because temporal gait parameters are used to compute higher-level gait features and the accuracy of spatiotemporal parameter measurement using IMU was evaluated as appropriate, our study could also measure the gait cycle and divide it into four phases using IMU [22].
The hardware of the gait analysis system used in this study consisted of PC and wireless IMU sensors (Fig. 1). Using a Bluetooth module with 100 Hz serial peripheral interface (SPI) communication, the PC received signals from the sensors without direct connection.
Extraction of kinematic parameters and segmentation of the gait cycle
Utilizing the motion information gathered from all sensors attached to the patients, the 3D joint angles were calibrated. In this study, the gait data on both sides of the limbs were averaged based on the gait cycle. This is because we believed that if we analyzed the left and right sides separately, the number of cases would be too large to lead to a meaningful performance of the machine learning method. Based on the data, we were able to show how the joint angle changed throughout the whole gait cycle (Fig. 2). And then, 72 gait features could be listed to classify KOA patients, which described the kinematic components of the gait patterns (Table 2). Through the process of subdividing joint angles during the gait cycle, abnormal gait patterns and their cause could be explained.
Machine learning application for the classification of knee osteoarthritis
To classify KOA patients and severity, a machine learning algorithm was used in this study. The SVM is a supervised learning model with associated learning algorithms used to find a support vector. A support vector is an optimal hyperplane that separates two data classes. The SVM figures out the hyperplane with a maximum-margin via process finding two data in two groups with the shortest distance. It is a brief overview of the SVM (Fig. 3), and if it cannot draw a dividing line in two-dimensional space, the kernel function can be applied in a higher dimensional space to classify data.
With the z-scores calculated, all gait features were normalized and then applied to the classifiers. In this study, a 5-fold cross-validation scheme was performed to assess the possibility of generalization of the classifier, and the results were attained through the accuracy result. After splitting data set into five subsets, one subset was used as a test set and the remaining four subsets were used as training sets.
From all gait analyses, we collected the feature set data and operated it using the MATLAB Classification Learner Tool. Using the SVM classifier, we calculated the distance between data from KOA patients and normal subjects and generated a model capable of classifying each cluster by distance. A flow chart of our classification algorithm is shown in Fig. 4. By using this algorithm, we generated a model that can classify KOA patients through a machine learning technique. For successful feature selection that is notably sensitive to feature interactions, the ReliefF algorithm was used. A feature score for each feature was calculated and applied to find the highest scoring features for feature selection. A flow diagram of this algorithm is shown in Fig. 5.
Statistical analysis
We also performed a logistic regression analysis to compare the results of conventional medical statistical methods and machine learning in classifying KOA patients and normal subjects. Age, gender, height, weight, duration of one gait cycle, gait speed, cadence, and the maximum knee flexion angle were used as covariates and the presence of KOA (KOA patients group vs. normal subjects group) was used as dependent variable in the logistic regression model. Odds ratios (ORs) and 95% confidence intervals (CIs) were used to show the associations in the logistic regression analysis, and Nagelkerke’s R2 statistic was calculated to determine the variance in classification of KOA patients and normal subjects. Statistical analysis was performed with SPSS Statistics software (IBM SPSS, First Armonk, NY, USA).
RESULTS
Primarily, the result values of basic gait parameters for each group are shown in Supplementary Table S1. The mean and standard deviation values for the range of motion (ROM) of the aforementioned 72 gait features are shown in Supplementary Table S2. All subjects were divided into two groups (KOA and control) based on the 72 gait features. We used the MATLAB Classification Learner to assess the accuracy of the SVM classifier, which was 92.8% (Table 3). Then, machine learning-based classification through the SVM classifier was shown as a scatter plot with two-dimensions. We constructed a 2×2 confusion matrix with actual and predicted values, and visualized the performance of machine learning-based classification (Fig. 6).
We also classified the severity of KOA patients by the 72 gait features. Calculated in the same way as mentioned above, the accuracy of the SVM classifier was 81.2%. To know how the number of the features affects our classification, a forward feature selection algorithm was used in this study. By using the ReliefF algorithm, we found the best combination of kinematic features among all 72 features. As a result, we found the 10 features which showed the highest accuracy of 85.6% and were superior to classification with all 72 features (Table 4).
As the same as above, we displayed machine learningbased classification through an SVM classifier in scatter plot form with two-dimensions. We also constructed a 4×4 confusion matrix with actual and predicted values, and visualized the performance of machine learningbased classification (Fig. 7).
Regarding the feature selection process using the ReliefF algorithm, Fig. 8 shows the accuracy of each feature set and the highest accuracy of classification was found to be 85.6% when optimal 10 features were used. It is noteworthy that classifiers trained with a suitable number of features showed better performance in classification.
In addition, among the 72 gait features representing the kinematic data of subjects, the three most critical features in abnormal gait were listed by the level of their contributions. When classifying KOA patients and normal subjects, the primary contributions were left knee flexion and extension in the SW, secondary contributions were right knee flexion and extension in SW, and the tertiary contributions were ankle dorsiflexion and plantarflexion in the SS. When classifying mild, moderate, and severe KOA patients and normal subjects, the primary and secondary contributions were the same as those from the previous classification, and the tertiary contributions were internal and external knee rotation in the SS.
In the classification of KOA severity in this study, Fig. 9 presents the most crucial features in the sagittal plane of the knee.
In the logistic regression analysis for the classification of KOA patients and normal subjects, the final model included the maximum knee flexion angle of the right (OR=1.106; 95% CI, 1.038–1.179; p=0.002) and left (OR=1.110; 95% CI, 1.039–1.186; p=0.002) knee and cadence (OR=1.076; 95% CI, 1.017–1.138; p=0.010). The final logistic regression model explained 58.0% (Nagelkerke’s R2) of the variance in the classification of KOA patients and normal subjects and correctly classified 83.9% of cases (Table 5).
DISCUSSION
Today, as physicians have begun to recognize that KOA is caused by various factors including genetic, inflammatory, and mechanical processes, KOA, to a certain extent, is thought to be a preventable disease. Therefore, early intervention is required through accurate early diagnosis of KOA.
The severity of KOA can be assessed by radiologically (K-L grading system), arthroscopically (Collins system), and functionally (Western Ontario and McMaster Universities Osteoarthritis index) [23,24].
The most widely used method of radiologic grading and KOA identification is described by Kellgren and Lawrence as the K-L grading system [5,23]. Although it has been used for decades, debates regarding its limitations are ongoing. The K-L grading system has difficulty in evaluating the progress of disease and can be harmful due to the repetitive radiation exposure. Since many studies have adapted this classification in various ways, it can also be inconsistent with its original description [5,25]. Simultaneously, some previous studies have criticized the consistency of the pre-standardized classification of KOA. Schiphof et al. [26] performed an epidemiological cohort study from 1966 to 2005 to summarize the different descriptions of KOA classifications from previous studies. Remarkably, disagreement on the definition and grading system of KOA between some major OA cohort studies was shown despite their accordance with following the original K-L grading system. Some studies even had inconsistencies within themselves.
In the past few decades, the technology related to human motion analysis has shown remarkable advancements and as a result, our understanding of human body motion and the accuracy of gait analysis have significantly improved. Consequently, gait analysis can be utilized in the medical field and considered a clinically useful technique.
Recently, the effort to use gait analysis as a methodology for KOA research and actual clinical application has increased significantly [15]. Many studies on KOA using gait analysis investigated representative gait patterns of KOA patients and reported differences in gait parameters compared to normal subjects [10,11,27-29].
Mills et al. [30] conducted a systematic review and meta-analysis on the biomechanical deviations of KOA patients. It revealed spatiotemporal parameters as a great scale to determine the severity of KOA. Astephen et al. [31] implied that as the disease progressed, the role which the biomechanical factors played depended on the different stages of severity. Previous studies have reported the kinetics and kinematics for different stages of KOA. In terms of kinetics, Mundermann et al. [10] reported a sufficient hip adduction moment and reduced second peak knee adduction moment in less severe KOA patients, and reduced hip adduction moment and increased first peak knee adduction moment in more severe KOA patients considering the gait compensatory mechanism. Similarly, Chang et al. [32] reported that a greater hip abduction moment occurring during gait reduced the progression of ipsilateral medial KOA in relatively less advanced KOA patients. Meissier et al. [33] and Al-Zahrani and Bakheit [12] conducted studies in more severe KOA patients and reported significantly reduced ROM in the hip, knee, and ankle joints. They reported that these kinematic gait abnormalities observed in severe KOA patients were due to the instability of the knee joint, and rehabilitative interventions that improved knee stability enhanced the walking ability of severe KOA patients. KOA is a joint disease, which inevitably affects all lower limb joints including both sides of the hip, knee, and ankle. In addition, through analysis of the gait of KOA patients in a number of previous studies, the most significantly changed kinematic parameter was determined to be the knee flexion ROM [6,34]. Therefore, in this study, we proceeded using ROM data in the kinematic parameters.
However, previously used camera-based gait analysis cannot be easily performed due to challenges such as appropriate space, costs, and time required for testing [35]. It also requires complicated image processing and appropriate lighting conditions to operate normally [36]. To compensate for the limitations shown in camera-based methods, this study used a wireless form of wearable IMU. The strength of wearable IMU systems is that they are radiation-free, small-sized, and cost effective, and it made them to be widely used. Beange et al. [37] reported that the IMU system not only had a higher accuracy compared to Vicon but also was sufficient to be used in clinical settings.
Today, almost every part of our daily lives is affected by machine learning and big data. In general, clinicians can feel unfamiliar with big data and machine learning. However, machine learning is a similar method in principle to traditional statistics. Machine learning has emerged as an important and powerful technique in the medical field. By applying machine learning to clinical settings, we can expect advances at the level of global health. By developing a prognostic algorithm, better assessments can improve the care for patients with various diseases and thereby improve the prognosis. A large part of the role of anatomical pathologists and radiologists will be replaced by machine learning. Finally, through machine learning, diagnosis will become more consistent and accurate [38].
Shetty et al. [17] reported the successful classification of Parkinson’s disease from amyotrophic lateral sclerosis, Huntington’s disease, and healthy controls using a machine learning method. This study used a Gaussian radial basis function kernel based SVM classifier and achieved an overall classification accuracy of 83.33% after feature vector selection. Mezghani et al. [18] classified asymptomatic and KOA subjects. They analyzed gait patterns by measuring the 3D ground reaction force, and the data was classified using the nearest neighbor rule. Finally, with the wavelet decomposition using force components in the frontal and transverse planes, the accuracy of classification between the two groups was 94%.
In this study, using all 72 gait features for machine learning-based classification, the results revealed a classification accuracy of 92.8% between the KOA and control groups, and 81.2% among three groups according to the severity of KOA. Then, the process of feature selection needed to classify KOA patients according to the severity was performed by ReliefF algorithm, and we found that not all features were necessary to classify the severity of KOA. Consequently, when 10 optimal features were used in classification, the accuracy showed the highest value of 85.6%. These results suggest that the process of feature selection increased efficiency in data processing and the accuracy of classification by excluding unnecessary gait features. Therefore, the eventual reduction in the number of used features is helpful for optimizing machine learning algorithms and helping clinicians to easily understand the process. This improvement of accuracy via feature selection was supported by previous studies about classification of scoliosis and diagnosis of glaucoma [16,39].
From the gait analysis in this study, the data on kinematic and spatiotemporal parameters were gathered from the sensors attached to the patients. Based on the data, dynamic changes of the joint angle according to the four segmented stages (IDS, SS, TDS, and SW) are described in Fig. 2.
As previous studies that incorporated gait analysis into KOA assessment have mainly used conventional statistics such as t-tests and regression analyses [40], we also conducted a logistic regression analysis as a conventional medical statistical method to compare the results with the machine learning-based method for the classification of KOA patients and normal subjects. From the logistic regression analysis using both the demographic characteristics and spatiotemporal parameters, we found the final model with the maximum knee flexion angle and cadence. This final logistic regression model correctly classified 83.9% of cases, which was lower than the machine learning-based method which correctly classified 92.8% of cases. Even though the independent variables used in the two methods were not identical to each other, we could acquire the additional evidence of methodological validity in the machine learning-based classification method.
There are several limitations in our study. First, although gait speed is known to affect gait kinematics, we conducted this study without controlling for gait speed. We thought that instead of controlling gait speed by performing gait trials on a treadmill, it was more important to analyze the subjects’ gait patterns in their daily lives under the same experimental conditions. Second, this study failed to control for the effects of pain which are one of the most common symptoms of KOA patients and can also affect the kinematics of gait. Third, we did not perform radiographic evaluation of the normal control group because of the risk of radiation exposure. Thus, we could not compare radiologic findings between KOA patients and normal subjects. Fourth, in this study, we conducted the study based only on the K-L grade of the affected limb which was defined as the more symptomatic side, and patients with symmetric severity of KOA were excluded from the study. In the future, it would be a good idea to collect enough study subjects and conduct research on patients with symmetric severity of KOA. Fifth, although we were able to achieve considerable reliability in the machine learning-based classification of KOA patients, research on either modification of abnormal gait patterns or future treatment was not included in this study. Therefore, the study on these aspects needs to be conducted afterwards.
In conclusion, this study proposed a new KOA classification method using machine learning for KOA patients and normal subjects and compared its performance with the conventional statistical processing technique. We recognized that the machine learning-based method could complement conventional logistic regression analysis in the classification of KOA patients and normal subjects. Furthermore, the machine learning technique is thought to be able to overcome a clinician’s lack of access due to limitations on the complexity and massive amount of data presented in gait analysis. In addition, we expect that the results of this study can be used for the diagnosis of KOA patients and rehabilitative intervention through gait correction.
XML Download