{"title":"基于图像编码和双通道融合网络的有效动作识别方法","authors":"Yukun Wang;Junlong Zhu","doi":"10.1109/JSEN.2025.3596568","DOIUrl":null,"url":null,"abstract":"Action recognition is a research hotspot in artificial intelligence, with significant applications in intelligent sports analysis, health monitoring, and human–computer interaction. Traditional methods rely on high-frame-rate cameras or complex motion capture systems, which are costly and highly dependent on environmental conditions. In contrast, data-driven methods based on wearable sensors have gained widespread attention due to their portability and cost-effectiveness. In this article, we propose an action recognition method based on image encoding and a dual-channel feature extraction network. We convert time-series data collected from wearable sensors into color images through image encoding, fully preserving the temporal information and multidimensional feature relationships in the data. Then, we design a dual-channel feature extraction network that extracts complex features using a multiscale spatial channel attention (MSCA) module, a dual-stream alternating feature fusion (DAF) module, and a weighted loss function (WFL). We conducted experiments on the USC-HAD and PAMAP2 datasets, demonstrating that our method outperforms several state-of-the-art methods. Ablation studies further verify the contributions of the backbone network, fusion module, classifier, and loss function to the overall performance. Overall, our method provides a new solution for action recognition tasks and shows broad application prospects.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 18","pages":"35144-35156"},"PeriodicalIF":4.3000,"publicationDate":"2025-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Effective Action Recognition Method Based on Image Coding and a Dual-Channel Fusion Network\",\"authors\":\"Yukun Wang;Junlong Zhu\",\"doi\":\"10.1109/JSEN.2025.3596568\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Action recognition is a research hotspot in artificial intelligence, with significant applications in intelligent sports analysis, health monitoring, and human–computer interaction. Traditional methods rely on high-frame-rate cameras or complex motion capture systems, which are costly and highly dependent on environmental conditions. In contrast, data-driven methods based on wearable sensors have gained widespread attention due to their portability and cost-effectiveness. In this article, we propose an action recognition method based on image encoding and a dual-channel feature extraction network. We convert time-series data collected from wearable sensors into color images through image encoding, fully preserving the temporal information and multidimensional feature relationships in the data. Then, we design a dual-channel feature extraction network that extracts complex features using a multiscale spatial channel attention (MSCA) module, a dual-stream alternating feature fusion (DAF) module, and a weighted loss function (WFL). We conducted experiments on the USC-HAD and PAMAP2 datasets, demonstrating that our method outperforms several state-of-the-art methods. Ablation studies further verify the contributions of the backbone network, fusion module, classifier, and loss function to the overall performance. Overall, our method provides a new solution for action recognition tasks and shows broad application prospects.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 18\",\"pages\":\"35144-35156\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-08-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11124422/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/11124422/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
An Effective Action Recognition Method Based on Image Coding and a Dual-Channel Fusion Network
Action recognition is a research hotspot in artificial intelligence, with significant applications in intelligent sports analysis, health monitoring, and human–computer interaction. Traditional methods rely on high-frame-rate cameras or complex motion capture systems, which are costly and highly dependent on environmental conditions. In contrast, data-driven methods based on wearable sensors have gained widespread attention due to their portability and cost-effectiveness. In this article, we propose an action recognition method based on image encoding and a dual-channel feature extraction network. We convert time-series data collected from wearable sensors into color images through image encoding, fully preserving the temporal information and multidimensional feature relationships in the data. Then, we design a dual-channel feature extraction network that extracts complex features using a multiscale spatial channel attention (MSCA) module, a dual-stream alternating feature fusion (DAF) module, and a weighted loss function (WFL). We conducted experiments on the USC-HAD and PAMAP2 datasets, demonstrating that our method outperforms several state-of-the-art methods. Ablation studies further verify the contributions of the backbone network, fusion module, classifier, and loss function to the overall performance. Overall, our method provides a new solution for action recognition tasks and shows broad application prospects.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice