Colum Crowe, Corina Naughton, Marguerite de Foubert, Helen Cummins, Ruth McCullagh, Dawn A. Skelton, Darren Dahly, Brendan Palmer, Brendan O’Flynn, Salvatore Tedesco
{"title":"Treatment effect analysis of the Frailty Care Bundle (FCB) in a cohort of patients in acute care settings","authors":"Colum Crowe, Corina Naughton, Marguerite de Foubert, Helen Cummins, Ruth McCullagh, Dawn A. Skelton, Darren Dahly, Brendan Palmer, Brendan O’Flynn, Salvatore Tedesco","doi":"10.1007/s40520-024-02840-5","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><p>The aim of this study is to explore the feasibility of using machine learning approaches to objectively differentiate the mobilization patterns, measured via accelerometer sensors, of patients pre- and post-intervention.</p><h3>Methods</h3><p>The intervention tested the implementation of a Frailty Care Bundle to improve mobilization, nutrition and cognition in older orthopedic patients. The study recruited 120 participants, a sub-group analysis was undertaken on 113 patients with accelerometer data (57 pre-intervention and 56 post-intervention), the median age was 78 years and the majority were female. Physical activity data from an ankle-worn accelerometer (StepWatch 4) was collected for each patient during their hospital stay. These data contained daily aggregated gait variables. Data preprocessing included the standardization of step counts and feature computation. Subsequently, a binary classification model was trained. A systematic hyperparameter optimization approach was applied, and feature selection was performed. Two classifier models, logistic regression and Random Forest, were investigated and Shapley values were used to explain model predictions.</p><h3>Results</h3><p>The Random Forest classifier demonstrated an average balanced accuracy of 82.3% (± 1.7%) during training and 74.7% (± 8.2%) for the test set. In comparison, the logistic regression classifier achieved a training accuracy of 79.7% (± 1.9%) and a test accuracy of 77.6% (± 5.5%). The logistic regression model demonstrated less overfitting compared to the Random Forest model and better performance on the hold-out test set. Stride length was consistently chosen as a key feature in all iterations for both models, along with features related to stride velocity, gait speed, and Lyapunov exponent, indicating their significance in the classification.</p><h3>Conclusion</h3><p>The best performing classifier was able to distinguish between patients pre- and post-intervention with greater than 75% accuracy. The intervention showed a correlation with higher gait speed and reduced stride length. However, the question of whether these alterations are part of an adaptive process that leads to improved outcomes over time remains.</p></div>","PeriodicalId":7720,"journal":{"name":"Aging Clinical and Experimental Research","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s40520-024-02840-5.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Aging Clinical and Experimental Research","FirstCategoryId":"3","ListUrlMain":"https://link.springer.com/article/10.1007/s40520-024-02840-5","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"GERIATRICS & GERONTOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
The aim of this study is to explore the feasibility of using machine learning approaches to objectively differentiate the mobilization patterns, measured via accelerometer sensors, of patients pre- and post-intervention.
Methods
The intervention tested the implementation of a Frailty Care Bundle to improve mobilization, nutrition and cognition in older orthopedic patients. The study recruited 120 participants, a sub-group analysis was undertaken on 113 patients with accelerometer data (57 pre-intervention and 56 post-intervention), the median age was 78 years and the majority were female. Physical activity data from an ankle-worn accelerometer (StepWatch 4) was collected for each patient during their hospital stay. These data contained daily aggregated gait variables. Data preprocessing included the standardization of step counts and feature computation. Subsequently, a binary classification model was trained. A systematic hyperparameter optimization approach was applied, and feature selection was performed. Two classifier models, logistic regression and Random Forest, were investigated and Shapley values were used to explain model predictions.
Results
The Random Forest classifier demonstrated an average balanced accuracy of 82.3% (± 1.7%) during training and 74.7% (± 8.2%) for the test set. In comparison, the logistic regression classifier achieved a training accuracy of 79.7% (± 1.9%) and a test accuracy of 77.6% (± 5.5%). The logistic regression model demonstrated less overfitting compared to the Random Forest model and better performance on the hold-out test set. Stride length was consistently chosen as a key feature in all iterations for both models, along with features related to stride velocity, gait speed, and Lyapunov exponent, indicating their significance in the classification.
Conclusion
The best performing classifier was able to distinguish between patients pre- and post-intervention with greater than 75% accuracy. The intervention showed a correlation with higher gait speed and reduced stride length. However, the question of whether these alterations are part of an adaptive process that leads to improved outcomes over time remains.
期刊介绍:
Aging clinical and experimental research offers a multidisciplinary forum on the progressing field of gerontology and geriatrics. The areas covered by the journal include: biogerontology, neurosciences, epidemiology, clinical gerontology and geriatric assessment, social, economical and behavioral gerontology. “Aging clinical and experimental research” appears bimonthly and publishes review articles, original papers and case reports.