Rongbao Huang , Bo Zhang , Zhixin Yao , Bojun Xie , Jia Guo
{"title":"DESNet:结合物联网和深度学习,为体育应用提供实时人体姿态估计","authors":"Rongbao Huang , Bo Zhang , Zhixin Yao , Bojun Xie , Jia Guo","doi":"10.1016/j.aej.2024.10.010","DOIUrl":null,"url":null,"abstract":"<div><div>With the rapid development of IoT technology, real-time human pose estimation has become increasingly important in sports training feedback systems. However, current methods often fall short in balancing high accuracy with low computational resource requirements, especially in resource-constrained environments. Deep learning has shown significant potential in enhancing computer vision tasks, including human pose estimation. In this study, we propose DESNet, an improved EfficientHRNet model that integrates IoT technology. DESNet combines Dynamic Multi-Scale Context (DMC) modules and Squeeze-and-Excitation (SE) modules, and utilizes IoT for real-time data collection, transmission, and processing. Experimental results show that DESNet achieves an average precision (AP) of 74.8% on the COCO dataset and a PCKh (Percentage of Correct Keypoints with head-normalized) of 90.9% on the MPII dataset, outperforming existing lightweight models. The integration of deep learning and IoT technology not only improves the accuracy and efficiency of human pose estimation but also significantly enhances the timeliness and robustness of feedback in sports training applications. Our findings demonstrate that DESNet is a powerful tool for real-time human pose analysis, offering promising solutions for intelligent sports training and rehabilitation systems.</div></div>","PeriodicalId":7484,"journal":{"name":"alexandria engineering journal","volume":null,"pages":null},"PeriodicalIF":6.2000,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DESNet: Real-time human pose estimation for sports applications combining IoT and deep learning\",\"authors\":\"Rongbao Huang , Bo Zhang , Zhixin Yao , Bojun Xie , Jia Guo\",\"doi\":\"10.1016/j.aej.2024.10.010\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>With the rapid development of IoT technology, real-time human pose estimation has become increasingly important in sports training feedback systems. However, current methods often fall short in balancing high accuracy with low computational resource requirements, especially in resource-constrained environments. Deep learning has shown significant potential in enhancing computer vision tasks, including human pose estimation. In this study, we propose DESNet, an improved EfficientHRNet model that integrates IoT technology. DESNet combines Dynamic Multi-Scale Context (DMC) modules and Squeeze-and-Excitation (SE) modules, and utilizes IoT for real-time data collection, transmission, and processing. Experimental results show that DESNet achieves an average precision (AP) of 74.8% on the COCO dataset and a PCKh (Percentage of Correct Keypoints with head-normalized) of 90.9% on the MPII dataset, outperforming existing lightweight models. The integration of deep learning and IoT technology not only improves the accuracy and efficiency of human pose estimation but also significantly enhances the timeliness and robustness of feedback in sports training applications. Our findings demonstrate that DESNet is a powerful tool for real-time human pose analysis, offering promising solutions for intelligent sports training and rehabilitation systems.</div></div>\",\"PeriodicalId\":7484,\"journal\":{\"name\":\"alexandria engineering journal\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":6.2000,\"publicationDate\":\"2024-11-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"alexandria engineering journal\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1110016824011657\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"alexandria engineering journal","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1110016824011657","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
DESNet: Real-time human pose estimation for sports applications combining IoT and deep learning
With the rapid development of IoT technology, real-time human pose estimation has become increasingly important in sports training feedback systems. However, current methods often fall short in balancing high accuracy with low computational resource requirements, especially in resource-constrained environments. Deep learning has shown significant potential in enhancing computer vision tasks, including human pose estimation. In this study, we propose DESNet, an improved EfficientHRNet model that integrates IoT technology. DESNet combines Dynamic Multi-Scale Context (DMC) modules and Squeeze-and-Excitation (SE) modules, and utilizes IoT for real-time data collection, transmission, and processing. Experimental results show that DESNet achieves an average precision (AP) of 74.8% on the COCO dataset and a PCKh (Percentage of Correct Keypoints with head-normalized) of 90.9% on the MPII dataset, outperforming existing lightweight models. The integration of deep learning and IoT technology not only improves the accuracy and efficiency of human pose estimation but also significantly enhances the timeliness and robustness of feedback in sports training applications. Our findings demonstrate that DESNet is a powerful tool for real-time human pose analysis, offering promising solutions for intelligent sports training and rehabilitation systems.
期刊介绍:
Alexandria Engineering Journal is an international journal devoted to publishing high quality papers in the field of engineering and applied science. Alexandria Engineering Journal is cited in the Engineering Information Services (EIS) and the Chemical Abstracts (CA). The papers published in Alexandria Engineering Journal are grouped into five sections, according to the following classification:
• Mechanical, Production, Marine and Textile Engineering
• Electrical Engineering, Computer Science and Nuclear Engineering
• Civil and Architecture Engineering
• Chemical Engineering and Applied Sciences
• Environmental Engineering