{"title":"利用预测分析技术在巴基斯坦开展为期一年的急诊医学认证项目,为高风险学习者提供支持。","authors":"Saima Ali, Syed Ghazanfar Saleem, Priya Arumuganathan, Sama Mukhtar, Adeel Khatri, Megan Rybarczyk","doi":"10.1080/0142159X.2025.2519645","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Predictive analytics and Machine Learning (PAML) are gaining traction in health professions education (HPE). Their utilization includes, but is not limited to, guiding student enrollment, identifying at-risk learners, enhancing educational decisions, and allocating proper resources through data-driven insights. This study explored the use of PAML to identify at-risk learners in a one-year Certification Program in Emergency Medicine (CPEM) at the Indus Hospital and Health Network (IHHN), Pakistan with the aim of providing targeted educational support for improved outcome.</p><p><strong>Methodology: </strong>By leveraging data from prior CPEM cohorts (2018-2022, <i>n</i> = 91), regression tree and linear regression machine learning models were compared to predict the final examination performance of the CPEM 2023 learner cohort (<i>n</i> = 26). The models were prospectively applied to identify at-risk learners (<i>n</i> = 14/26). Extra learning support (ELS) was offered as an inclusive measure to everyone, not just the ones flagged by the models and was accepted by ten learners. Data were analyzed for model accuracy and the impact of the educational intervention.</p><p><strong>Results: </strong>Both models showed high accuracy (regression tree: Area Under the Receiver Operating Characteristic (ROC) Curve (AUC)= 0.89; linear regression: AUC= 0.88), though the regression tree model demonstrated slightly better sensitivity and specificity. The models altogether predicted unsatisfactory performance for 14 learners scheduled to sit for the 2023 final examination. Following targeted intervention, eight learners showed improvement in their final scores. Regression tree model was comparatively better in making predictions; however, both models had their limitation.</p><p><strong>Conclusion: </strong>The study demonstrated the feasibility and utility of using PAML to identify at-risk learners and tailor support strategies for enhancing educational outcome in low-resource settings. This additional support can augment expert judgement and ensure equitable educational practices. However, model limitations and ethical concerns, such as algorithmic bias, overfitting, and data imbalance, must be actively addressed in high-stakes assessments.[Box: see text].</p>","PeriodicalId":18643,"journal":{"name":"Medical Teacher","volume":" ","pages":"1-8"},"PeriodicalIF":3.3000,"publicationDate":"2025-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Harnessing predictive analytics to support high-risk learners in a one-year certification program in emergency medicine (CPEM) in Pakistan.\",\"authors\":\"Saima Ali, Syed Ghazanfar Saleem, Priya Arumuganathan, Sama Mukhtar, Adeel Khatri, Megan Rybarczyk\",\"doi\":\"10.1080/0142159X.2025.2519645\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>Predictive analytics and Machine Learning (PAML) are gaining traction in health professions education (HPE). Their utilization includes, but is not limited to, guiding student enrollment, identifying at-risk learners, enhancing educational decisions, and allocating proper resources through data-driven insights. This study explored the use of PAML to identify at-risk learners in a one-year Certification Program in Emergency Medicine (CPEM) at the Indus Hospital and Health Network (IHHN), Pakistan with the aim of providing targeted educational support for improved outcome.</p><p><strong>Methodology: </strong>By leveraging data from prior CPEM cohorts (2018-2022, <i>n</i> = 91), regression tree and linear regression machine learning models were compared to predict the final examination performance of the CPEM 2023 learner cohort (<i>n</i> = 26). The models were prospectively applied to identify at-risk learners (<i>n</i> = 14/26). Extra learning support (ELS) was offered as an inclusive measure to everyone, not just the ones flagged by the models and was accepted by ten learners. Data were analyzed for model accuracy and the impact of the educational intervention.</p><p><strong>Results: </strong>Both models showed high accuracy (regression tree: Area Under the Receiver Operating Characteristic (ROC) Curve (AUC)= 0.89; linear regression: AUC= 0.88), though the regression tree model demonstrated slightly better sensitivity and specificity. The models altogether predicted unsatisfactory performance for 14 learners scheduled to sit for the 2023 final examination. Following targeted intervention, eight learners showed improvement in their final scores. Regression tree model was comparatively better in making predictions; however, both models had their limitation.</p><p><strong>Conclusion: </strong>The study demonstrated the feasibility and utility of using PAML to identify at-risk learners and tailor support strategies for enhancing educational outcome in low-resource settings. This additional support can augment expert judgement and ensure equitable educational practices. However, model limitations and ethical concerns, such as algorithmic bias, overfitting, and data imbalance, must be actively addressed in high-stakes assessments.[Box: see text].</p>\",\"PeriodicalId\":18643,\"journal\":{\"name\":\"Medical Teacher\",\"volume\":\" \",\"pages\":\"1-8\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2025-06-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Medical Teacher\",\"FirstCategoryId\":\"95\",\"ListUrlMain\":\"https://doi.org/10.1080/0142159X.2025.2519645\",\"RegionNum\":2,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION, SCIENTIFIC DISCIPLINES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical Teacher","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1080/0142159X.2025.2519645","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
Harnessing predictive analytics to support high-risk learners in a one-year certification program in emergency medicine (CPEM) in Pakistan.
Introduction: Predictive analytics and Machine Learning (PAML) are gaining traction in health professions education (HPE). Their utilization includes, but is not limited to, guiding student enrollment, identifying at-risk learners, enhancing educational decisions, and allocating proper resources through data-driven insights. This study explored the use of PAML to identify at-risk learners in a one-year Certification Program in Emergency Medicine (CPEM) at the Indus Hospital and Health Network (IHHN), Pakistan with the aim of providing targeted educational support for improved outcome.
Methodology: By leveraging data from prior CPEM cohorts (2018-2022, n = 91), regression tree and linear regression machine learning models were compared to predict the final examination performance of the CPEM 2023 learner cohort (n = 26). The models were prospectively applied to identify at-risk learners (n = 14/26). Extra learning support (ELS) was offered as an inclusive measure to everyone, not just the ones flagged by the models and was accepted by ten learners. Data were analyzed for model accuracy and the impact of the educational intervention.
Results: Both models showed high accuracy (regression tree: Area Under the Receiver Operating Characteristic (ROC) Curve (AUC)= 0.89; linear regression: AUC= 0.88), though the regression tree model demonstrated slightly better sensitivity and specificity. The models altogether predicted unsatisfactory performance for 14 learners scheduled to sit for the 2023 final examination. Following targeted intervention, eight learners showed improvement in their final scores. Regression tree model was comparatively better in making predictions; however, both models had their limitation.
Conclusion: The study demonstrated the feasibility and utility of using PAML to identify at-risk learners and tailor support strategies for enhancing educational outcome in low-resource settings. This additional support can augment expert judgement and ensure equitable educational practices. However, model limitations and ethical concerns, such as algorithmic bias, overfitting, and data imbalance, must be actively addressed in high-stakes assessments.[Box: see text].
期刊介绍:
Medical Teacher provides accounts of new teaching methods, guidance on structuring courses and assessing achievement, and serves as a forum for communication between medical teachers and those involved in general education. In particular, the journal recognizes the problems teachers have in keeping up-to-date with the developments in educational methods that lead to more effective teaching and learning at a time when the content of the curriculum—from medical procedures to policy changes in health care provision—is also changing. The journal features reports of innovation and research in medical education, case studies, survey articles, practical guidelines, reviews of current literature and book reviews. All articles are peer reviewed.