Predict Students' Dropout and Academic Success with XGBoost
DOI:
https://doi.org/10.69693/jeca.v1i2.13Keywords:
Student Dropout, Academic Prediction, XGBoost, Education Data Analysis, Strategic InterventionsAbstract
The attrition rate of students in higher education is a worldwide issue that profoundly affects both individuals and institutions. Students who fail to complete their studies often encounter economic and social difficulties, while educational institutions suffer a deterioration in reputation and operational efficacy. This paper proposes the creation of a prediction model utilizing the XGBoost algorithm to assess students' academic progress and dropout risk. The model incorporates several elements, such as academic, demographic, and socio-economic, to yield comprehensive insights into students' educational trends. This research utilizes the Predict Students' Dropout and Academic Success dataset, comprising 4,424 data points and 36 attributes. The data underwent normalization via StandardScaler and was divided into five scenarios for training and testing, ranging from a 50:50 to a 90:10 split. The evaluation of the model was conducted utilizing accuracy, precision, recall, and F1-Score criteria. The findings indicate that the model attains peak performance in the 80:20 scenario, exhibiting 88% precision and an 81% F1-Score, signifying an ideal equilibrium between predictive accuracy and risk identification capability. This study demonstrates that XGBoost can serve as a dependable predictive instrument to aid decision-making in the education sector. These findings establish a foundation for formulating targeted interventions aimed at enhancing student retention. Subsequent study may investigate the use of real-time data and sophisticated models to enhance predictive accuracy.
Downloads
References
D. K. Dake and C. Buabeng-Andoh, “Using Machine Learning Techniques to Predict Learner Drop-out Rate in Higher Educational Institutions,” Mob. Inf. Syst., vol. 2022, pp. 1–9, Nov. 2022, doi: 10.1155/2022/2670562.
C. Bargmann, L. Thiele, and S. Kauffeld, “Motivation matters: predicting students’ career decidedness and intention to drop out after the first year in higher education,” High. Educ., vol. 83, no. 4, pp. 845–861, Apr. 2022, doi: 10.1007/s10734-021-00707-6.
C. Aina, E. Baici, G. Casalone, and F. Pastore, “The determinants of university dropout: A review of the socio-economic literature,” Socioecon. Plann. Sci., vol. 79, p. 101102, Feb. 2022, doi: 10.1016/j.seps.2021.101102.
R. Z. Pek, S. T. Ozyer, T. Elhage, T. Ozyer, and R. Alhajj, “The Role of Machine Learning in Identifying Students At-Risk and Minimizing Failure,” IEEE Access, vol. 11, pp. 1224–1243, 2023, doi: 10.1109/ACCESS.2022.3232984.
J. C. Véliz Palomino and A. M. Ortega, “Dropout Intentions in Higher Education: Systematic Literature Review,” J. Effic. Responsib. Educ. Sci., vol. 16, no. 2, pp. 149–158, Jun. 2023, doi: 10.7160/eriesj.2023.160206.
A. Namoun and A. Alshanqiti, “Predicting Student Performance Using Data Mining and Learning Analytics Techniques: A Systematic Literature Review,” Appl. Sci., vol. 11, no. 1, p. 237, Dec. 2020, doi: 10.3390/app11010237.
B. Albreiki, N. Zaki, and H. Alashwal, “A Systematic Literature Review of Student’ Performance Prediction Using Machine Learning Techniques,” Educ. Sci., vol. 11, no. 9, p. 552, Sep. 2021, doi: 10.3390/educsci11090552.
A. Khan and S. K. Ghosh, “Student performance analysis and prediction in classroom learning: A review of educational data mining studies,” Educ. Inf. Technol., vol. 26, no. 1, pp. 205–240, Jan. 2021, doi: 10.1007/s10639-020-10230-3.
J. L. Rastrollo-Guerrero, J. A. Gómez-Pulido, and A. Durán-Domínguez, “Analyzing and Predicting Students’ Performance by Means of Machine Learning: A Review,” Appl. Sci., vol. 10, no. 3, p. 1042, Feb. 2020, doi: 10.3390/app10031042.
J. López-Zambrano, J. Lara Torralbo, and C. Romero, “Early Prediction of Student Learning Performance Through Data Mining: A Systematic Review,” Psicothema, vol. 3, no. 33, pp. 456–465, Aug. 2021, doi: 10.7334/psicothema2021.62.
V. Realinho, J. Machado, L. Baptista, and M. V. Martins, “Predicting Student Dropout and Academic Success,” Data, vol. 7, no. 11, p. 146, Oct. 2022, doi: 10.3390/data7110146.
D. Andrade-Girón et al., “Predicting Student Dropout based on Machine Learning and Deep Learning: A Systematic Review,” ICST Trans. Scalable Inf. Syst., vol. 10, no. 5, pp. 1–11, Jul. 2023, doi: 10.4108/eetsis.3586.
N. Mduma, “Data Balancing Techniques for Predicting Student Dropout Using Machine Learning,” Data, vol. 8, no. 3, p. 49, Feb. 2023, doi: 10.3390/data8030049.
K. Yan, “Student Performance Prediction Using XGBoost Method from A Macro Perspective,” in 2021 2nd International Conference on Computing and Data Science (CDS), Jan. 2021, pp. 453–459. doi: 10.1109/CDS52072.2021.00084.
J. Mun and M. Jo, “Applying machine learning-based models to prevent University student dropouts,” Korean Soc. Educ. Eval., vol. 36, no. 2, pp. 289–313, Jun. 2023, doi: 10.31158/JEEV.2023.36.2.289.
H. Huo et al., “Predicting Dropout for Nontraditional Undergraduate Students: A Machine Learning Approach,” J. Coll. Student Retent. Res. Theory Pract., vol. 24, no. 4, pp. 1054–1077, Feb. 2023, doi: 10.1177/1521025120963821.
D. Duan, C. Dai, and R. Tu, “Research on the Prediction of Students’ Academic Performance Based on XGBoost,” in 2021 Tenth International Conference of Educational Innovation through Technology (EITT), Dec. 2021, pp. 316–319. doi: 10.1109/EITT53287.2021.00068.
M. V. Martins, D. Tolledo, J. Machado, L. M. T. Baptista, and V. Realinho, “Early Prediction of student’s Performance in Higher Education: A Case Study,” in Trends and Applications in Information Systems and Technologies, 2021, pp. 166–175. doi: 10.1007/978-3-030-72657-7_16.
D. Singh and B. Singh, “Feature wise normalization: An effective way of normalizing data,” Pattern Recognit., vol. 122, p. 108307, Feb. 2022, doi: 10.1016/j.patcog.2021.108307.
A. M. Priyatno, “Spammer Detection Based on Account, Tweet, and Community Activity on Twitter,” J. Ilmu Komput. dan Inf., vol. 13, no. 2, pp. 97–107, Jul. 2020, doi: 10.21609/jiki.v13i2.871.
L. B. V. de Amorim, G. D. C. Cavalcanti, and R. M. O. Cruz, “The choice of scaling technique matters for classification performance,” Appl. Soft Comput., vol. 133, p. 109924, Jan. 2023, doi: 10.1016/j.asoc.2022.109924.
Y. Matsubara, M. Levorato, and F. Restuccia, “Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges,” ACM Comput. Surv., vol. 55, no. 5, pp. 1–30, May 2023, doi: 10.1145/3527155.
A. M. Priyatno and F. I. Firmananda, “N-Gram Feature for Comparison of Machine Learning Methods on Sentiment in Financial News Headlines,” RIGGS J. Artif. Intell. Digit. Bus., vol. 1, no. 1, pp. 01–06, Jul. 2022, doi: 10.31004/riggs.v1i1.4.
T. Kavzoglu and A. Teke, “Predictive Performances of Ensemble Machine Learning Algorithms in Landslide Susceptibility Mapping Using Random Forest, Extreme Gradient Boosting (XGBoost) and Natural Gradient Boosting (NGBoost),” Arab. J. Sci. Eng., vol. 47, no. 6, pp. 7367–7385, Jun. 2022, doi: 10.1007/s13369-022-06560-8.
T. Kavzoglu and A. Teke, “Advanced hyperparameter optimization for improved spatial prediction of shallow landslides using extreme gradient boosting (XGBoost),” Bull. Eng. Geol. Environ., vol. 81, no. 5, p. 201, May 2022, doi: 10.1007/s10064-022-02708-w.
A. Asselman, M. Khaldi, and S. Aammou, “Enhancing the prediction of student performance based on the machine learning XGBoost algorithm,” Interact. Learn. Environ., vol. 31, no. 6, pp. 3360–3379, Aug. 2023, doi: 10.1080/10494820.2021.1928235.
M. M. Taye, “Understanding of Machine Learning with Deep Learning: Architectures, Workflow, Applications and Future Directions,” Computers, vol. 12, no. 5, p. 91, Apr. 2023, doi: 10.3390/computers12050091.
A. M. Priyatno and L. Ningsih, “TF - IDF Weighting to Detect Spammer Accounts on Twitter based on Tweets and Retweet Representation of Tweets,” Sist. J. Sist. Inf., vol. 11, no. 3, pp. 614–622, 2022, [Online]. Available: http://sistemasi.ftik.unisi.ac.id/index.php/stmsi/issue/view/46
M. R. A. Prasetya and A. M. Priyatno, “Dice Similarity and TF-IDF for New Student Admissions Chatbot,” RIGGS J. Artif. Intell. Digit. Bus., vol. 1, no. 1, pp. 13–18, Jul. 2022, doi: 10.31004/riggs.v1i1.5.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Journal of Education and Computer Applications
This work is licensed under a Creative Commons Attribution 4.0 International License.
