Yifan Wu;Li Wu;Taiyang Hu;Zelong Xiao;Mengxuan Xiao;Lei Li
{"title":"基于增强GMM和混合SNN的高效雷达手势识别方法","authors":"Yifan Wu;Li Wu;Taiyang Hu;Zelong Xiao;Mengxuan Xiao;Lei Li","doi":"10.1109/JSEN.2025.3543875","DOIUrl":null,"url":null,"abstract":"This article proposes an energy-efficient and high-accuracy gesture recognition framework to address the challenges of high computational complexity and interference susceptibility in conventional radar-based gesture recognition methods. First, an enhanced Gaussian mixture model (GMM) with an optimized learning rate is introduced to improve anti-interference performance by exploiting spatial and velocity differences between gesture signals and target-like interference. Furthermore, a novel spiking neural network (SNN) architecture is proposed, combining a 2-D convolutional neural-network (2D-CNN) for spatial feature extraction with a long short-term memory (LSTM) network for capturing, long-term temporal dependencies. This hybrid architecture effectively integrates short-term and long-term temporal dynamics to enhance recognition accuracy. Additionally, spike-timing-dependent plasticity (STDP) is incorporated to address the non-differentiability of spike-based data, thereby improving the network’s feature learning capabilities. To evaluate the proposed approach, a radar-based gesture dataset comprising seven gesture categories was constructed using a 60-GHz frequency-modulated continuous wave (FMCW) radar system. Experimental results demonstrate a recognition accuracy of 99.28%, alongside computational complexity and power consumption have better performance than the existing competitive methods, suiting power and resource-constrained environments.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 7","pages":"12511-12524"},"PeriodicalIF":4.3000,"publicationDate":"2025-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Efficient Radar-Based Gesture Recognition Method Using Enhanced GMM and Hybrid SNN\",\"authors\":\"Yifan Wu;Li Wu;Taiyang Hu;Zelong Xiao;Mengxuan Xiao;Lei Li\",\"doi\":\"10.1109/JSEN.2025.3543875\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This article proposes an energy-efficient and high-accuracy gesture recognition framework to address the challenges of high computational complexity and interference susceptibility in conventional radar-based gesture recognition methods. First, an enhanced Gaussian mixture model (GMM) with an optimized learning rate is introduced to improve anti-interference performance by exploiting spatial and velocity differences between gesture signals and target-like interference. Furthermore, a novel spiking neural network (SNN) architecture is proposed, combining a 2-D convolutional neural-network (2D-CNN) for spatial feature extraction with a long short-term memory (LSTM) network for capturing, long-term temporal dependencies. This hybrid architecture effectively integrates short-term and long-term temporal dynamics to enhance recognition accuracy. Additionally, spike-timing-dependent plasticity (STDP) is incorporated to address the non-differentiability of spike-based data, thereby improving the network’s feature learning capabilities. To evaluate the proposed approach, a radar-based gesture dataset comprising seven gesture categories was constructed using a 60-GHz frequency-modulated continuous wave (FMCW) radar system. Experimental results demonstrate a recognition accuracy of 99.28%, alongside computational complexity and power consumption have better performance than the existing competitive methods, suiting power and resource-constrained environments.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 7\",\"pages\":\"12511-12524\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-02-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10908530/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10908530/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
An Efficient Radar-Based Gesture Recognition Method Using Enhanced GMM and Hybrid SNN
This article proposes an energy-efficient and high-accuracy gesture recognition framework to address the challenges of high computational complexity and interference susceptibility in conventional radar-based gesture recognition methods. First, an enhanced Gaussian mixture model (GMM) with an optimized learning rate is introduced to improve anti-interference performance by exploiting spatial and velocity differences between gesture signals and target-like interference. Furthermore, a novel spiking neural network (SNN) architecture is proposed, combining a 2-D convolutional neural-network (2D-CNN) for spatial feature extraction with a long short-term memory (LSTM) network for capturing, long-term temporal dependencies. This hybrid architecture effectively integrates short-term and long-term temporal dynamics to enhance recognition accuracy. Additionally, spike-timing-dependent plasticity (STDP) is incorporated to address the non-differentiability of spike-based data, thereby improving the network’s feature learning capabilities. To evaluate the proposed approach, a radar-based gesture dataset comprising seven gesture categories was constructed using a 60-GHz frequency-modulated continuous wave (FMCW) radar system. Experimental results demonstrate a recognition accuracy of 99.28%, alongside computational complexity and power consumption have better performance than the existing competitive methods, suiting power and resource-constrained environments.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice