Deep learning-based improvement of joint angle accuracy for uncalibrated multi-view markerless three-dimensional motion capture.

IF 2.8 3区 工程技术 Q3 ENGINEERING, INDUSTRIAL
Taeu Kim, Myung-Chul Jung, Seung-Min Mo
{"title":"Deep learning-based improvement of joint angle accuracy for uncalibrated multi-view markerless three-dimensional motion capture.","authors":"Taeu Kim, Myung-Chul Jung, Seung-Min Mo","doi":"10.1080/00140139.2026.2718967","DOIUrl":null,"url":null,"abstract":"<p><p>This study aimed to improve and validate the accuracy of joint angles estimated using a mixture of uncalibrated cameras (MUC), an uncalibrated multi-view markerless three-dimensional motion capture system, through bidirectional long short-term memory (BiLSTM) based correction. Twelve male participants performed bricklaying, assembly, and parcel loading while marker-based and multi-view markerless motion capture data were recorded simultaneously. MUC-derived joint angles were corrected using a BiLSTM model trained against marker-based reference values. Representative RMSE reductions were 48.9° to 25.0° for shoulder abduction-adduction in bricklaying, 11.3° to 5.8° for elbow flexion in assembly, and RMSE from 40.0° to 16.7° for knee flexion in parcel loading. Pearson's correlation and ICC improved for several motions, while Bland-Altman analysis showed reduced fixed and proportional bias and narrower limits of agreement in selected motions. These findings support BiLSTM-based correction for industrial ergonomic assessment.</p>","PeriodicalId":50503,"journal":{"name":"Ergonomics","volume":" ","pages":"1-27"},"PeriodicalIF":2.8000,"publicationDate":"2026-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ergonomics","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1080/00140139.2026.2718967","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0

Abstract

This study aimed to improve and validate the accuracy of joint angles estimated using a mixture of uncalibrated cameras (MUC), an uncalibrated multi-view markerless three-dimensional motion capture system, through bidirectional long short-term memory (BiLSTM) based correction. Twelve male participants performed bricklaying, assembly, and parcel loading while marker-based and multi-view markerless motion capture data were recorded simultaneously. MUC-derived joint angles were corrected using a BiLSTM model trained against marker-based reference values. Representative RMSE reductions were 48.9° to 25.0° for shoulder abduction-adduction in bricklaying, 11.3° to 5.8° for elbow flexion in assembly, and RMSE from 40.0° to 16.7° for knee flexion in parcel loading. Pearson's correlation and ICC improved for several motions, while Bland-Altman analysis showed reduced fixed and proportional bias and narrower limits of agreement in selected motions. These findings support BiLSTM-based correction for industrial ergonomic assessment.

基于深度学习的无标定多视点无标记三维运动捕捉关节角度精度改进。
本研究旨在通过基于双向长短期记忆(BiLSTM)的校正,提高和验证使用混合未校准摄像机(MUC)估计关节角度的准确性,这是一种未校准的多视角无标记三维运动捕捉系统。12名男性参与者进行砌砖、组装和包裹装载,同时记录基于标记和多视图无标记的动作捕捉数据。使用基于标记的参考值训练的BiLSTM模型对muc衍生的关节角度进行校正。砌砖时肩部外展-内收时RMSE降低48.9°至25.0°,组装时肘关节屈曲时RMSE降低11.3°至5.8°,装货时膝关节屈曲时RMSE降低40.0°至16.7°。Pearson的相关性和ICC在几个动议中有所改善,而Bland-Altman分析显示,在选定的动议中,固定和比例偏差减少,一致性限制更窄。这些发现支持基于bilstm的工业人体工程学评估校正。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Ergonomics
Ergonomics 工程技术-工程:工业
CiteScore
4.60
自引率
12.50%
发文量
147
审稿时长
6 months
期刊介绍: Ergonomics, also known as human factors, is the scientific discipline that seeks to understand and improve human interactions with products, equipment, environments and systems. Drawing upon human biology, psychology, engineering and design, Ergonomics aims to develop and apply knowledge and techniques to optimise system performance, whilst protecting the health, safety and well-being of individuals involved. The attention of ergonomics extends across work, leisure and other aspects of our daily lives. The journal Ergonomics is an international refereed publication, with a 60 year tradition of disseminating high quality research. Original submissions, both theoretical and applied, are invited from across the subject, including physical, cognitive, organisational and environmental ergonomics. Papers reporting the findings of research from cognate disciplines are also welcome, where these contribute to understanding equipment, tasks, jobs, systems and environments and the corresponding needs, abilities and limitations of people. All published research articles in this journal have undergone rigorous peer review, based on initial editor screening and anonymous refereeing by independent expert referees.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书