Intra and inter-system reliability of a markerless motion capture system in different configurations during functional tasks: Implications for utility

IF 2.3 4区医学 Q3 ENGINEERING, BIOMEDICAL

Medical Engineering & Physics Pub Date : 2025-06-04 DOI:10.1016/j.medengphy.2025.104375

Mark W. Lenhoff, Silvia Zanini, Gregory Chingas, Snehal Patel, Robert DiGiacomo, Howard J. Hillstrom

{"title":"Intra and inter-system reliability of a markerless motion capture system in different configurations during functional tasks: Implications for utility","authors":"Mark W. Lenhoff, Silvia Zanini, Gregory Chingas, Snehal Patel, Robert DiGiacomo, Howard J. Hillstrom","doi":"10.1016/j.medengphy.2025.104375","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Markerless motion capture is faster than a traditional marker-based method, but its reliability is not well established. The limitations of this new technology must be understood to ensure its appropriate utilization.</div></div><div><h3>Research Question</h3><div>Does a markerless motion capture system exhibit intra-device and inter-device reliability with an Intraclass Correlation Coefficient (ICC) > 0.70 during functional tasks?</div></div><div><h3>Methods</h3><div>Twenty test subjects were asked to squat and walk three times to compute the test-retest (repeated task with the same scaled skeletal model applied) and remove-replace (repeated task with two independently generated skeletal models applied) intra-device reliability for each of three devices and the inter-device reliability between the devices. Two devices were configured in a standard volume, and one device was configured sub-optimally in a larger volume.</div></div><div><h3>Results</h3><div>For intra-device reliability, the average squat range of motion (ROM) test-retest ICC was 0.86 and average squat remove-replace ICC was 0.74. The average walk ROM test-retest ICC was 0.70 and the average walk remove-replace ICC was 0.72. For inter-device reliability between the two devices in the standard volume, the average ICC was 0.82 for squat and 0.72 for walk. With the sub-optimally configured device included for a three-device analysis the average inter-device reliability ICC dropped to 0.55 for squat and 0.46 for walk.</div></div><div><h3>Significance</h3><div>Larger field of view, suboptimal camera placement and tasks performed away from the center of the field of view presented challenges to the DARI markerless mocap system. Intra-device and inter-device reliability can achieve a level of ICC > 0.7 using DARI markerless mocap technology using an optimized setup, but the transverse plane kinematics exhibit the weakest performance. Optimal camera placement (i.e., field of view) is critical for reliable results.</div></div>","PeriodicalId":49836,"journal":{"name":"Medical Engineering & Physics","volume":"142 ","pages":"Article 104375"},"PeriodicalIF":2.3000,"publicationDate":"2025-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical Engineering & Physics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1350453325000943","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}

引用次数: 0

Abstract

Background

Markerless motion capture is faster than a traditional marker-based method, but its reliability is not well established. The limitations of this new technology must be understood to ensure its appropriate utilization.

Research Question

Does a markerless motion capture system exhibit intra-device and inter-device reliability with an Intraclass Correlation Coefficient (ICC) > 0.70 during functional tasks?

Methods

Twenty test subjects were asked to squat and walk three times to compute the test-retest (repeated task with the same scaled skeletal model applied) and remove-replace (repeated task with two independently generated skeletal models applied) intra-device reliability for each of three devices and the inter-device reliability between the devices. Two devices were configured in a standard volume, and one device was configured sub-optimally in a larger volume.

Results

For intra-device reliability, the average squat range of motion (ROM) test-retest ICC was 0.86 and average squat remove-replace ICC was 0.74. The average walk ROM test-retest ICC was 0.70 and the average walk remove-replace ICC was 0.72. For inter-device reliability between the two devices in the standard volume, the average ICC was 0.82 for squat and 0.72 for walk. With the sub-optimally configured device included for a three-device analysis the average inter-device reliability ICC dropped to 0.55 for squat and 0.46 for walk.

Significance

Larger field of view, suboptimal camera placement and tasks performed away from the center of the field of view presented challenges to the DARI markerless mocap system. Intra-device and inter-device reliability can achieve a level of ICC > 0.7 using DARI markerless mocap technology using an optimized setup, but the transverse plane kinematics exhibit the weakest performance. Optimal camera placement (i.e., field of view) is critical for reliable results.

查看原文本刊更多论文

功能任务中不同配置下无标记动作捕捉系统的内部和系统间可靠性：对实用性的影响

无背景标记的运动捕捉比传统的基于标记的方法更快，但其可靠性尚未得到很好的验证。必须了解这项新技术的局限性，以确保其得到适当利用。无标记动作捕捉系统是否具有类内相关系数（ICC）的设备内和设备间可靠性？在功能性任务中0.70 ？方法要求20名被试蹲走三次，计算三种设备的测试-重测试（使用相同比例的骨骼模型的重复任务）和移除-替换（使用两个独立生成的骨骼模型的重复任务）设备内可靠性和设备间可靠性。在一个标准卷中配置了两个设备，在一个更大的卷中配置了一个设备。结果器械内可靠性方面，深蹲运动范围（ROM）测试-重测ICC平均为0.86，深蹲移除-替换ICC平均为0.74。walk ROM test-retest ICC平均为0.70，walk remove-replace ICC平均为0.72。对于标准体积中两个设备之间的设备间可靠性，蹲下时的平均ICC为0.82，行走时为0.72。将次优化配置的设备纳入三设备分析后，设备间的平均可靠性ICC在蹲下时降至0.55，在行走时降至0.46。更大的视场、次优的相机位置和远离视场中心的任务对DARI无标记动作捕捉系统提出了挑战。设备内和设备间的可靠性可达到ICC >级别；0.7使用优化设置的DARI无标记动作捕捉技术，但横向平面运动学表现出最弱的性能。最佳相机位置（即视野）对于可靠的结果至关重要。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Medical Engineering & Physics 工程技术-工程：生物医学

CiteScore

4.30

自引率

4.50%

发文量

172

审稿时长

3.0 months

期刊介绍： Medical Engineering & Physics provides a forum for the publication of the latest developments in biomedical engineering, and reflects the essential multidisciplinary nature of the subject. The journal publishes in-depth critical reviews, scientific papers and technical notes. Our focus encompasses the application of the basic principles of physics and engineering to the development of medical devices and technology, with the ultimate aim of producing improvements in the quality of health care.Topics covered include biomechanics, biomaterials, mechanobiology, rehabilitation engineering, biomedical signal processing and medical device development. Medical Engineering & Physics aims to keep both engineers and clinicians abreast of the latest applications of technology to health care.