Surveillance-Driven Machine Learning for Prediction of Antimicrobial Susceptibility: An Explainable Modeling Framework using the Pfizer ATLAS Dataset (2004 - 2023).
Raphael Mutua, David Gichohi, Samuel K Ndegwa, Rahma O Golicha, Frida Njeru, Benson Kituku
{"title":"Surveillance-Driven Machine Learning for Prediction of Antimicrobial Susceptibility: An Explainable Modeling Framework using the Pfizer ATLAS Dataset (2004 - 2023).","authors":"Raphael Mutua, David Gichohi, Samuel K Ndegwa, Rahma O Golicha, Frida Njeru, Benson Kituku","doi":"10.12688/wellcomeopenres.26477.2","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Antimicrobial resistance (AMR) is a growing global public health threat, particularly in low- and middle-income countries (LMICs), where delayed antimicrobial susceptibility testing (AST) and limited diagnostic capacity complicate timely treatment and antimicrobial stewardship (AMS). Although large-scale surveillance programmes routinely collect antimicrobial susceptibility data, these datasets remain underutilised for predictive analytics.</p><p><strong>Methods: </strong>We developed a surveillance-driven machine learning (ML) framework using isolate-level data from African sites participating in the Pfizer Antimicrobial Testing Leadership and Surveillance (ATLAS) programme between 2019 and 2023. Seven antibiotic-specific Extreme Gradient Boosting (XGBoost) models were developed to predict antimicrobial susceptibility using routinely collected microbiological, demographic, clinical, and geographical metadata. Model development included structured data preprocessing, RandomOverSampler-based class balancing restricted to the training data, hyperparameter optimisation using stratified cross-validation, and evaluation on a held-out test dataset. A rule-based MIC interpretation system and interactive dashboard were developed to demonstrate implementation of the analytical workflow.</p><p><strong>Results: </strong>The antibiotic-specific models demonstrated moderate predictive performance, with test accuracies ranging from 57% to 76%. Ceftazidime-Avibactam achieved the highest test accuracy (76%), followed by Gentamicin (65%) and Imipenem (64%), while Amikacin showed the lowest performance (57%). Feature-importance analysis identified bacterial species as consistently among the most influential predictors. In contrast, bacterial family, country of isolate collection, specimen source, clinical specialty, and demographic characteristics contributed to varying degrees across antibiotics. Performance was generally stronger for the more frequently represented susceptible class than for intermediate and resistant isolates.</p><p><strong>Conclusion: </strong>Routinely collected AMR surveillance data can support antibiotic-specific ML predictions without requiring genomic sequencing or detailed patient-level clinical information. This study provides a proof-of-concept framework for surveillance-driven predictive analytics that could complement conventional AMR surveillance and AMS. External validation, calibration, prospective clinical evaluation, and implementation studies are required before routine deployment.</p>","PeriodicalId":23677,"journal":{"name":"Wellcome Open Research","volume":"11 ","pages":"393"},"PeriodicalIF":0.0000,"publicationDate":"2026-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13624498/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Wellcome Open Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.12688/wellcomeopenres.26477.2","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Antimicrobial resistance (AMR) is a growing global public health threat, particularly in low- and middle-income countries (LMICs), where delayed antimicrobial susceptibility testing (AST) and limited diagnostic capacity complicate timely treatment and antimicrobial stewardship (AMS). Although large-scale surveillance programmes routinely collect antimicrobial susceptibility data, these datasets remain underutilised for predictive analytics.
Methods: We developed a surveillance-driven machine learning (ML) framework using isolate-level data from African sites participating in the Pfizer Antimicrobial Testing Leadership and Surveillance (ATLAS) programme between 2019 and 2023. Seven antibiotic-specific Extreme Gradient Boosting (XGBoost) models were developed to predict antimicrobial susceptibility using routinely collected microbiological, demographic, clinical, and geographical metadata. Model development included structured data preprocessing, RandomOverSampler-based class balancing restricted to the training data, hyperparameter optimisation using stratified cross-validation, and evaluation on a held-out test dataset. A rule-based MIC interpretation system and interactive dashboard were developed to demonstrate implementation of the analytical workflow.
Results: The antibiotic-specific models demonstrated moderate predictive performance, with test accuracies ranging from 57% to 76%. Ceftazidime-Avibactam achieved the highest test accuracy (76%), followed by Gentamicin (65%) and Imipenem (64%), while Amikacin showed the lowest performance (57%). Feature-importance analysis identified bacterial species as consistently among the most influential predictors. In contrast, bacterial family, country of isolate collection, specimen source, clinical specialty, and demographic characteristics contributed to varying degrees across antibiotics. Performance was generally stronger for the more frequently represented susceptible class than for intermediate and resistant isolates.
Conclusion: Routinely collected AMR surveillance data can support antibiotic-specific ML predictions without requiring genomic sequencing or detailed patient-level clinical information. This study provides a proof-of-concept framework for surveillance-driven predictive analytics that could complement conventional AMR surveillance and AMS. External validation, calibration, prospective clinical evaluation, and implementation studies are required before routine deployment.
Wellcome Open ResearchBiochemistry, Genetics and Molecular Biology-Biochemistry, Genetics and Molecular Biology (all)
CiteScore
5.50
自引率
0.00%
发文量
426
审稿时长
1 weeks
期刊介绍:
Wellcome Open Research publishes scholarly articles reporting any basic scientific, translational and clinical research that has been funded (or co-funded) by Wellcome. Each publication must have at least one author who has been, or still is, a recipient of a Wellcome grant. Articles must be original (not duplications). All research, including clinical trials, systematic reviews, software tools, method articles, and many others, is welcome and will be published irrespective of the perceived level of interest or novelty; confirmatory and negative results, as well as null studies are all suitable. See the full list of article types here. All articles are published using a fully transparent, author-driven model: the authors are solely responsible for the content of their article. Invited peer review takes place openly after publication, and the authors play a crucial role in ensuring that the article is peer-reviewed by independent experts in a timely manner. Articles that pass peer review will be indexed in PubMed and elsewhere. Wellcome Open Research is an Open Research platform: all articles are published open access; the publishing and peer-review processes are fully transparent; and authors are asked to include detailed descriptions of methods and to provide full and easy access to source data underlying the results to improve reproducibility.