Evaluating the Accuracy and Reliability of Real-World Digital Mobility Outcomes in Older Adults After Hip Fracture: Cross-Sectional Observational Study.
Martin A Berge, Anisoara Paraschiv-Ionescu, Cameron Kirk, Arne Küderle, Encarna Micó-Amigo, Clemens Becker, Andrea Cereatti, Silvia Del Din, Monika Engdal, Judith Garcia-Aymerich, Karoline B Grønvik, Clint Hansen, Jeffrey M Hausdorff, Jorunn L Helbostad, Carl-Philipp Jansen, Lars Gunnar Johnsen, Jochen Klenk, Sarah Koch, Walter Maetzler, Dimitrios Megaritis, Arne Müller, Lynn Rochester, Lars Schwickert, Kristin Taraldsen, Beatrix Vereijken
{"title":"Evaluating the Accuracy and Reliability of Real-World Digital Mobility Outcomes in Older Adults After Hip Fracture: Cross-Sectional Observational Study.","authors":"Martin A Berge, Anisoara Paraschiv-Ionescu, Cameron Kirk, Arne Küderle, Encarna Micó-Amigo, Clemens Becker, Andrea Cereatti, Silvia Del Din, Monika Engdal, Judith Garcia-Aymerich, Karoline B Grønvik, Clint Hansen, Jeffrey M Hausdorff, Jorunn L Helbostad, Carl-Philipp Jansen, Lars Gunnar Johnsen, Jochen Klenk, Sarah Koch, Walter Maetzler, Dimitrios Megaritis, Arne Müller, Lynn Rochester, Lars Schwickert, Kristin Taraldsen, Beatrix Vereijken","doi":"10.2196/67792","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Algorithms estimating real-world digital mobility outcomes (DMOs) are increasingly validated in healthy adults and various disease cohorts. However, their accuracy and reliability in older adults after hip fracture, who often walk slowly for short durations, is underexplored.</p><p><strong>Objective: </strong>This study examined DMO accuracy and reliability in a hip fracture cohort considering walking bout (WB) duration, physical function, days since surgery, and walking aid use.</p><p><strong>Methods: </strong>In total, 19 community-dwelling participants were real-world monitored for 2.5 hours using a lower back wearable device and a reference system combining inertial modules, distance sensors, and pressure insoles. A total of 6 DMO estimates from 164 WBs from 58% (11/19) of the participants (aged 71-90 years; assessed 32-390 days after surgery; Short Physical Performance Battery [SPPB] scores of 3-12; gait speed range 0.39-1.34 m/s) were assessed against the reference system at the WB and participant level. We stratified by WB duration (all WBs, WBs of >10 seconds, WBs of 10-30 seconds, and WBs of >30 seconds) and lower versus higher SPPB scores and observed whether days since surgery and walking aid use affected DMO accuracy and reliability.</p><p><strong>Results: </strong>Across WBs, walking speed and distance ranged from 0.25 to 1.29 m/s and from 1.7 to 436.5 m, respectively. Estimation of walking speed, cadence, stride duration, number of steps, and distance stratified by WB duration showed intraclass correlation coefficients (ICCs) ranging from 0.50 to 0.99 and mean relative errors (MREs) from -6.9% to 12.8%. Stride length estimation showed poor reliability, with ICCs ranging from 0.30 to 0.49 and MREs from 6.1% to 13.2%. Walking speed and distance ICCs in the higher-SPPB score group ranged from 0.85 to 0.99, and MREs ranged from -10.1% to -1.7%. In the lower-SPPB score group, walking speed and distance ICCs ranged from 0.17 to 0.99, and MREs ranged from 13.5% to 32.6%. There was no discernible effect of time since surgery or walking aid use.</p><p><strong>Conclusions: </strong>In total, 5 accurate and reliable real-world DMOs were identified in older adults after hip fracture: walking speed, cadence, stride duration, number of steps, and distance. Accuracy and reliability of most DMOs improved when excluding WBs of <10 seconds and were higher for WBs of >30 seconds than for WBs of 10 to 30 seconds and for participants with higher physical function. DMOs capture daily gait as early as 1 month after surgery also in people using walking aids. However, as most WBs in this cohort were short, there was a trade-off between improving accuracy and reliability by excluding short WBs and losing a substantial amount of data. These results have important implications for establishing the clinical validity of DMOs and evaluating the effects of interventions on daily-life gait, thereby facilitating the design of optimal care pathways.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"9 ","pages":"e67792"},"PeriodicalIF":2.0000,"publicationDate":"2025-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Formative Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/67792","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Algorithms estimating real-world digital mobility outcomes (DMOs) are increasingly validated in healthy adults and various disease cohorts. However, their accuracy and reliability in older adults after hip fracture, who often walk slowly for short durations, is underexplored.
Objective: This study examined DMO accuracy and reliability in a hip fracture cohort considering walking bout (WB) duration, physical function, days since surgery, and walking aid use.
Methods: In total, 19 community-dwelling participants were real-world monitored for 2.5 hours using a lower back wearable device and a reference system combining inertial modules, distance sensors, and pressure insoles. A total of 6 DMO estimates from 164 WBs from 58% (11/19) of the participants (aged 71-90 years; assessed 32-390 days after surgery; Short Physical Performance Battery [SPPB] scores of 3-12; gait speed range 0.39-1.34 m/s) were assessed against the reference system at the WB and participant level. We stratified by WB duration (all WBs, WBs of >10 seconds, WBs of 10-30 seconds, and WBs of >30 seconds) and lower versus higher SPPB scores and observed whether days since surgery and walking aid use affected DMO accuracy and reliability.
Results: Across WBs, walking speed and distance ranged from 0.25 to 1.29 m/s and from 1.7 to 436.5 m, respectively. Estimation of walking speed, cadence, stride duration, number of steps, and distance stratified by WB duration showed intraclass correlation coefficients (ICCs) ranging from 0.50 to 0.99 and mean relative errors (MREs) from -6.9% to 12.8%. Stride length estimation showed poor reliability, with ICCs ranging from 0.30 to 0.49 and MREs from 6.1% to 13.2%. Walking speed and distance ICCs in the higher-SPPB score group ranged from 0.85 to 0.99, and MREs ranged from -10.1% to -1.7%. In the lower-SPPB score group, walking speed and distance ICCs ranged from 0.17 to 0.99, and MREs ranged from 13.5% to 32.6%. There was no discernible effect of time since surgery or walking aid use.
Conclusions: In total, 5 accurate and reliable real-world DMOs were identified in older adults after hip fracture: walking speed, cadence, stride duration, number of steps, and distance. Accuracy and reliability of most DMOs improved when excluding WBs of <10 seconds and were higher for WBs of >30 seconds than for WBs of 10 to 30 seconds and for participants with higher physical function. DMOs capture daily gait as early as 1 month after surgery also in people using walking aids. However, as most WBs in this cohort were short, there was a trade-off between improving accuracy and reliability by excluding short WBs and losing a substantial amount of data. These results have important implications for establishing the clinical validity of DMOs and evaluating the effects of interventions on daily-life gait, thereby facilitating the design of optimal care pathways.