Zhiyong Xiao, Feng Yu, Li Liu, Tao Peng, Xinrong Hu, Minghua Jiang
{"title":"DSANet:用于虚拟运动中人类动作识别的轻量级混合网络","authors":"Zhiyong Xiao, Feng Yu, Li Liu, Tao Peng, Xinrong Hu, Minghua Jiang","doi":"10.1002/cav.2274","DOIUrl":null,"url":null,"abstract":"<p>Human activity recognition (HAR) has significant potential in virtual sports applications. However, current HAR networks often prioritize high accuracy at the expense of practical application requirements, resulting in networks with large parameter counts and computational complexity. This can pose challenges for real-time and efficient recognition. This paper proposes a hybrid lightweight DSANet network designed to address the challenges of real-time performance and algorithmic complexity. The network utilizes a multi-scale depthwise separable convolutional (Multi-scale DWCNN) module to extract spatial information and a multi-layer Gated Recurrent Unit (Multi-layer GRU) module for temporal feature extraction. It also incorporates an improved channel-space attention module called RCSFA to enhance feature extraction capability. By leveraging channel, spatial, and temporal information, the network achieves a low number of parameters with high accuracy. Experimental evaluations on UCIHAR, WISDM, and PAMAP2 datasets demonstrate that the network not only reduces parameter counts but also achieves accuracy rates of 97.55%, 98.99%, and 98.67%, respectively, compared to state-of-the-art networks. This research provides valuable insights for the virtual sports field and presents a novel network for real-time activity recognition deployment in embedded devices.</p>","PeriodicalId":50645,"journal":{"name":"Computer Animation and Virtual Worlds","volume":"35 3","pages":""},"PeriodicalIF":0.9000,"publicationDate":"2024-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DSANet: A lightweight hybrid network for human action recognition in virtual sports\",\"authors\":\"Zhiyong Xiao, Feng Yu, Li Liu, Tao Peng, Xinrong Hu, Minghua Jiang\",\"doi\":\"10.1002/cav.2274\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Human activity recognition (HAR) has significant potential in virtual sports applications. However, current HAR networks often prioritize high accuracy at the expense of practical application requirements, resulting in networks with large parameter counts and computational complexity. This can pose challenges for real-time and efficient recognition. This paper proposes a hybrid lightweight DSANet network designed to address the challenges of real-time performance and algorithmic complexity. The network utilizes a multi-scale depthwise separable convolutional (Multi-scale DWCNN) module to extract spatial information and a multi-layer Gated Recurrent Unit (Multi-layer GRU) module for temporal feature extraction. It also incorporates an improved channel-space attention module called RCSFA to enhance feature extraction capability. By leveraging channel, spatial, and temporal information, the network achieves a low number of parameters with high accuracy. Experimental evaluations on UCIHAR, WISDM, and PAMAP2 datasets demonstrate that the network not only reduces parameter counts but also achieves accuracy rates of 97.55%, 98.99%, and 98.67%, respectively, compared to state-of-the-art networks. This research provides valuable insights for the virtual sports field and presents a novel network for real-time activity recognition deployment in embedded devices.</p>\",\"PeriodicalId\":50645,\"journal\":{\"name\":\"Computer Animation and Virtual Worlds\",\"volume\":\"35 3\",\"pages\":\"\"},\"PeriodicalIF\":0.9000,\"publicationDate\":\"2024-05-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Animation and Virtual Worlds\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/cav.2274\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, SOFTWARE ENGINEERING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Animation and Virtual Worlds","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cav.2274","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
DSANet: A lightweight hybrid network for human action recognition in virtual sports
Human activity recognition (HAR) has significant potential in virtual sports applications. However, current HAR networks often prioritize high accuracy at the expense of practical application requirements, resulting in networks with large parameter counts and computational complexity. This can pose challenges for real-time and efficient recognition. This paper proposes a hybrid lightweight DSANet network designed to address the challenges of real-time performance and algorithmic complexity. The network utilizes a multi-scale depthwise separable convolutional (Multi-scale DWCNN) module to extract spatial information and a multi-layer Gated Recurrent Unit (Multi-layer GRU) module for temporal feature extraction. It also incorporates an improved channel-space attention module called RCSFA to enhance feature extraction capability. By leveraging channel, spatial, and temporal information, the network achieves a low number of parameters with high accuracy. Experimental evaluations on UCIHAR, WISDM, and PAMAP2 datasets demonstrate that the network not only reduces parameter counts but also achieves accuracy rates of 97.55%, 98.99%, and 98.67%, respectively, compared to state-of-the-art networks. This research provides valuable insights for the virtual sports field and presents a novel network for real-time activity recognition deployment in embedded devices.
期刊介绍:
With the advent of very powerful PCs and high-end graphics cards, there has been an incredible development in Virtual Worlds, real-time computer animation and simulation, games. But at the same time, new and cheaper Virtual Reality devices have appeared allowing an interaction with these real-time Virtual Worlds and even with real worlds through Augmented Reality. Three-dimensional characters, especially Virtual Humans are now of an exceptional quality, which allows to use them in the movie industry. But this is only a beginning, as with the development of Artificial Intelligence and Agent technology, these characters will become more and more autonomous and even intelligent. They will inhabit the Virtual Worlds in a Virtual Life together with animals and plants.