Open Source, Open Science: Development of OpenLESS as the Automated Landing Error Scoring System.

Jeffrey A Turner, Elaine T Reiche, Matthew T Hartshorne, Connor C Lee, Joanna M Blodgett, Darin A Padua
{"title":"Open Source, Open Science: Development of OpenLESS as the Automated Landing Error Scoring System.","authors":"Jeffrey A Turner, Elaine T Reiche, Matthew T Hartshorne, Connor C Lee, Joanna M Blodgett, Darin A Padua","doi":"10.1101/2024.11.28.24318160","DOIUrl":null,"url":null,"abstract":"<p><strong>Context: </strong>The Open Landing Error Scoring System (OpenLESS) is a novel development aimed at automating the LESS for assessment of lower extremity movement quality during a jump-landing task. With increasing utilization of clinical measures to monitor outcomes and limited time during clinical visits for a lengthy analysis of functional movement, there is a pressing need to extend automation efforts. Addressing these issues, OpenLESS is an open-source tool that utilizes a freely available markerless motion capture system to automate the LESS using three-dimensional kinematics.</p><p><strong>Objective: </strong>To describe the development of OpenLESS, examine the validity against expert rater LESS scores in healthy and clinically relevant cohorts, and assess the intersession reliability collected across four time points in an athlete cohort.</p><p><strong>Design: </strong>Observational.</p><p><strong>Participants: </strong>92 participants (72 females and 20 males, mean age 23.3 years) from healthy, post-anterior cruciate ligament reconstruction (ACLR; median 33 months since surgery), and amateur athlete cohorts.</p><p><strong>Main outcome measures: </strong>A software package, \"OpenLESS,\" was developed to interpret movement quality (LESS score) from kinematics captured from markerless motion capture. Validity and reliability were assessed with intraclass correlation coefficients (ICC), standard error of measure (SEM), and minimal detectable change (MDC).</p><p><strong>Results: </strong>OpenLESS agreed well with expert rater LESS scores for healthy (ICC <sub>2, <i>k</i></sub> =0.79) and clinically relevant, post-ACLR cohorts (ICC <sub>2, <i>k</i></sub> =0.88). The automated OpenLESS system reduced scoring time, processing all 159 trials in under 15 minutes compared to the 18.5 hours (7 minutes per trial) required for manual expert rater scoring. When tested outside laboratory conditions, OpenLESS showed excellent reliability across repeated sessions (ICC <sub>2, <i>k</i></sub> >0.89), with a SEM of 0.98 errors and MDC of 2.72 errors.</p><p><strong>Conclusion: </strong>OpenLESS shows promise as an efficient, automated tool for clinically assessing jump-landing quality, with good validity versus experts in healthy and post-ACLR populations, and excellent field reliability, addressing the need for objective movement analysis.</p><p><strong>Key points: </strong>OpenLESS accurately detected jump-landing events (ICC>0.99) using markerless motion capture, validating its use as an alternative to laboratory-based force plate measurements.The automated scoring system showed good agreement with expert raters in healthy (ICC=0.79) and post-ACLR (ICC=0.88) populations.OpenLESS demonstrated good to excellent test-retest reliability (ICC=0.89) across multiple testing sessions, with minimal score variation, supporting its utility for longitudinal movement assessment.</p>","PeriodicalId":94281,"journal":{"name":"medRxiv : the preprint server for health sciences","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11623740/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv : the preprint server for health sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.11.28.24318160","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Context: The Open Landing Error Scoring System (OpenLESS) is a novel development aimed at automating the LESS for assessment of lower extremity movement quality during a jump-landing task. With increasing utilization of clinical measures to monitor outcomes and limited time during clinical visits for a lengthy analysis of functional movement, there is a pressing need to extend automation efforts. Addressing these issues, OpenLESS is an open-source tool that utilizes a freely available markerless motion capture system to automate the LESS using three-dimensional kinematics.

Objective: To describe the development of OpenLESS, examine the validity against expert rater LESS scores in healthy and clinically relevant cohorts, and assess the intersession reliability collected across four time points in an athlete cohort.

Design: Observational.

Participants: 92 participants (72 females and 20 males, mean age 23.3 years) from healthy, post-anterior cruciate ligament reconstruction (ACLR; median 33 months since surgery), and amateur athlete cohorts.

Main outcome measures: A software package, "OpenLESS," was developed to interpret movement quality (LESS score) from kinematics captured from markerless motion capture. Validity and reliability were assessed with intraclass correlation coefficients (ICC), standard error of measure (SEM), and minimal detectable change (MDC).

Results: OpenLESS agreed well with expert rater LESS scores for healthy (ICC 2, k =0.79) and clinically relevant, post-ACLR cohorts (ICC 2, k =0.88). The automated OpenLESS system reduced scoring time, processing all 159 trials in under 15 minutes compared to the 18.5 hours (7 minutes per trial) required for manual expert rater scoring. When tested outside laboratory conditions, OpenLESS showed excellent reliability across repeated sessions (ICC 2, k >0.89), with a SEM of 0.98 errors and MDC of 2.72 errors.

Conclusion: OpenLESS shows promise as an efficient, automated tool for clinically assessing jump-landing quality, with good validity versus experts in healthy and post-ACLR populations, and excellent field reliability, addressing the need for objective movement analysis.

Key points: OpenLESS accurately detected jump-landing events (ICC>0.99) using markerless motion capture, validating its use as an alternative to laboratory-based force plate measurements.The automated scoring system showed good agreement with expert raters in healthy (ICC=0.79) and post-ACLR (ICC=0.88) populations.OpenLESS demonstrated good to excellent test-retest reliability (ICC=0.89) across multiple testing sessions, with minimal score variation, supporting its utility for longitudinal movement assessment.

求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信