An Ensemble Voting Approach for Dropout Student Classification Using Decision Tree C4.5, K-Nearest Neighbor and Backpropagation

Abstract

Many factors cause drop out in students. This study classified active students and drop out students using 1092 student data consisting of 557 active student data and 535 drop out student data. The independent variables used are Semester, Semester Credit Units (SKS), Semester Grade Point Average (IPS), Grade Point Average (IPK), admission pathways and Single Tuition Fee (UKT). Classification is carried out using the Ensemble Voting method where the method will combine the Decision Tree C4.5, KNN and Backpropagation methods as a single method. In addition to knowing the classification of active students and drop out students, this study aims to prove whether the Ensemble Voting method is able to get better results than the single method. This classification using a comparison of training and testing data of 90:10 to build model. Classification results from a single method will be included in the Ensemble Voting method. The Decision Tree C4.5 method gets 95.45% accuracy, 98.03% precision and 92.59% recall. KNN gets 96.36% accuracy, 100% precision and 92.59% recall. Backpropagation gets 90.90% accuracy, 95.83% precision and 95.18% recall. Meanwhile, the Ensemble Voting rule used is Ensemble Soft Voting with a weight of (2,1,1). Ensemble Voting with Ensemble Soft Voting rules is able to improve the accuracy, precision and recall values with 98.18% accuracy, 100% precision and 96.29% recall.