Evidence Based Gait Analysis Interpretation Tools (EB-GAIT) treatment recommendation and outcome prediction models to support decision-making based on clinical gait analysis data.
{"title":"Evidence Based Gait Analysis Interpretation Tools (EB-GAIT) treatment recommendation and outcome prediction models to support decision-making based on clinical gait analysis data.","authors":"Michael H Schwartz, Andrew G Georgiadis","doi":"10.1371/journal.pone.0328036","DOIUrl":null,"url":null,"abstract":"<p><p>Clinical gait analysis (CGA) has historically relied on clinician experience and judgment, leading to modest, stagnant, and unpredictable outcomes. This paper introduces Evidence-Based Gait Analysis Interpretation Tools (EB-GAIT), a novel framework leveraging machine learning to support treatment decisions. The core of EB-GAIT consists of two key components: (1) treatment recommendation models, which are models that estimate the probability of specific surgeries based on historical standard-of-practice (SOP), and (2) treatment outcome models, which predict changes in patient characteristics following treatment or natural history. Using Bayesian Additive Regression Trees (BART), we developed and validated treatment recommendation models for 12 common surgeries that account for more than 95% of the surgery recorded in our CGA center's database. These models demonstrated high balanced accuracy, sensitivity, and specificity. We used Shapley values for the models to enhances interpretability and allow clinicians and patients to understand the factors driving treatment recommendations. We also developed treatment outcome models for over 20 common outcome measures. These models were found to be unbiased, with reliable prediction intervals and accuracy comparable to experimental measurement error. We illustrated the application of EB-GAIT through a case study, showcasing its utility in providing treatment recommendations and outcome predictions. We then use simulations to show that combining recommendation and outcome models offers the possibility to improve outcomes for treated limbs, maintain outcomes for untreated limbs, and reduce the number of surgeries performed. For example, under the counterfactual situation where femoral derotation osteotomies are administered only when they align with historical standard of practice (> 50% probability of surgery) and are predicted to improve the Gait Deviation Index (change > 7.5 points), the model predicts a 11 percentage point reduction in surgeries (26% limbs currently, 15% limbs simulated), a 6 point improvement in Gait Deviation Index among treated limbs (6 currently, 12 simulated), and no change in Gait Deviation Index for untreated limbs (2 currently, 2 simulated). EB-GAIT represents a significant step toward precision medicine in CGA, offering a promising tool to enhance treatment outcomes and patient care. The EB-GAIT approach addresses the limitations of the conventional CGA interpretation method, offering a more structured and data-driven decision-making process. EB-GAIT is not intended to replace clinical judgment but to supplement it, providing clinicians with a second opinion grounded in historical data and predictive analytics. While the models perform well, their effectiveness is constrained by historical variability in treatment decisions and the inherent complexity of patient outcomes. Future efforts should focus on refining model inputs, incorporating surgical details, and pooling data from multiple centers to improve generalizability.</p>","PeriodicalId":20189,"journal":{"name":"PLoS ONE","volume":"20 7","pages":"e0328036"},"PeriodicalIF":2.6000,"publicationDate":"2025-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12306754/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PLoS ONE","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1371/journal.pone.0328036","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
Clinical gait analysis (CGA) has historically relied on clinician experience and judgment, leading to modest, stagnant, and unpredictable outcomes. This paper introduces Evidence-Based Gait Analysis Interpretation Tools (EB-GAIT), a novel framework leveraging machine learning to support treatment decisions. The core of EB-GAIT consists of two key components: (1) treatment recommendation models, which are models that estimate the probability of specific surgeries based on historical standard-of-practice (SOP), and (2) treatment outcome models, which predict changes in patient characteristics following treatment or natural history. Using Bayesian Additive Regression Trees (BART), we developed and validated treatment recommendation models for 12 common surgeries that account for more than 95% of the surgery recorded in our CGA center's database. These models demonstrated high balanced accuracy, sensitivity, and specificity. We used Shapley values for the models to enhances interpretability and allow clinicians and patients to understand the factors driving treatment recommendations. We also developed treatment outcome models for over 20 common outcome measures. These models were found to be unbiased, with reliable prediction intervals and accuracy comparable to experimental measurement error. We illustrated the application of EB-GAIT through a case study, showcasing its utility in providing treatment recommendations and outcome predictions. We then use simulations to show that combining recommendation and outcome models offers the possibility to improve outcomes for treated limbs, maintain outcomes for untreated limbs, and reduce the number of surgeries performed. For example, under the counterfactual situation where femoral derotation osteotomies are administered only when they align with historical standard of practice (> 50% probability of surgery) and are predicted to improve the Gait Deviation Index (change > 7.5 points), the model predicts a 11 percentage point reduction in surgeries (26% limbs currently, 15% limbs simulated), a 6 point improvement in Gait Deviation Index among treated limbs (6 currently, 12 simulated), and no change in Gait Deviation Index for untreated limbs (2 currently, 2 simulated). EB-GAIT represents a significant step toward precision medicine in CGA, offering a promising tool to enhance treatment outcomes and patient care. The EB-GAIT approach addresses the limitations of the conventional CGA interpretation method, offering a more structured and data-driven decision-making process. EB-GAIT is not intended to replace clinical judgment but to supplement it, providing clinicians with a second opinion grounded in historical data and predictive analytics. While the models perform well, their effectiveness is constrained by historical variability in treatment decisions and the inherent complexity of patient outcomes. Future efforts should focus on refining model inputs, incorporating surgical details, and pooling data from multiple centers to improve generalizability.
期刊介绍:
PLOS ONE is an international, peer-reviewed, open-access, online publication. PLOS ONE welcomes reports on primary research from any scientific discipline. It provides:
* Open-access—freely accessible online, authors retain copyright
* Fast publication times
* Peer review by expert, practicing researchers
* Post-publication tools to indicate quality and impact
* Community-based dialogue on articles
* Worldwide media coverage