{"title":"IoT-enhanced multi-attention and lightweight feature integration for human pose estimation in motion training systems","authors":"Junwen Chen , Jian Yang , Zhiqun Wang","doi":"10.1016/j.aej.2025.04.074","DOIUrl":null,"url":null,"abstract":"<div><div>Human pose estimation is widely used in intelligent sports training, rehabilitation assistance, and human–computer interaction, providing precise motion feedback and training guidance. However, existing methods suffer from keypoint localization errors and insufficient global coherence in complex backgrounds, occlusions, and high-dynamic motion scenarios. To address these challenges, this paper proposes a hybrid IoT-vision deep learning model for human pose estimation and motion training feedback. IoT-based motion sensors are integrated with vision-based keypoint detection to enhance pose estimation accuracy, particularly in occluded or high-speed movement scenarios. The model employs the LSFE stacked feature extraction module to enhance multi-scale feature adaptability, incorporates the LFAM local attention mechanism (SPAM + CARM) to improve key joint modeling, and introduces the GEAM global enhancement module to ensure keypoint stability and consistency. Additionally, an ECA-based lightweight channel attention mechanism reduces computational complexity while enhancing key feature responses. Experimental results show that the proposed model achieves Mean Accuracy of 0.946 and 0.949 on the LSP and MPII datasets, respectively, with PCK scores of 0.97 and 0.95. This model demonstrates significant improvements over existing methods in real-time performance and robustness, particularly in complex scenarios such as sports training, rehabilitation, and monitoring.</div></div>","PeriodicalId":7484,"journal":{"name":"alexandria engineering journal","volume":"127 ","pages":"Pages 284-295"},"PeriodicalIF":6.2000,"publicationDate":"2025-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"alexandria engineering journal","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1110016825005708","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Human pose estimation is widely used in intelligent sports training, rehabilitation assistance, and human–computer interaction, providing precise motion feedback and training guidance. However, existing methods suffer from keypoint localization errors and insufficient global coherence in complex backgrounds, occlusions, and high-dynamic motion scenarios. To address these challenges, this paper proposes a hybrid IoT-vision deep learning model for human pose estimation and motion training feedback. IoT-based motion sensors are integrated with vision-based keypoint detection to enhance pose estimation accuracy, particularly in occluded or high-speed movement scenarios. The model employs the LSFE stacked feature extraction module to enhance multi-scale feature adaptability, incorporates the LFAM local attention mechanism (SPAM + CARM) to improve key joint modeling, and introduces the GEAM global enhancement module to ensure keypoint stability and consistency. Additionally, an ECA-based lightweight channel attention mechanism reduces computational complexity while enhancing key feature responses. Experimental results show that the proposed model achieves Mean Accuracy of 0.946 and 0.949 on the LSP and MPII datasets, respectively, with PCK scores of 0.97 and 0.95. This model demonstrates significant improvements over existing methods in real-time performance and robustness, particularly in complex scenarios such as sports training, rehabilitation, and monitoring.
期刊介绍:
Alexandria Engineering Journal is an international journal devoted to publishing high quality papers in the field of engineering and applied science. Alexandria Engineering Journal is cited in the Engineering Information Services (EIS) and the Chemical Abstracts (CA). The papers published in Alexandria Engineering Journal are grouped into five sections, according to the following classification:
• Mechanical, Production, Marine and Textile Engineering
• Electrical Engineering, Computer Science and Nuclear Engineering
• Civil and Architecture Engineering
• Chemical Engineering and Applied Sciences
• Environmental Engineering