{"title":"DSC-GRUNet: A lightweight neural network model for multimodal gesture recognition based on depthwise separable convolutions and GRU","authors":"Huaigang Yang , Dong Zhang , Ping Xie , Xiaoling Chen","doi":"10.1016/j.patrec.2025.02.008","DOIUrl":null,"url":null,"abstract":"<div><div>With the advancement of human-computer interaction (HCI) technology, gesture recognition methods based on electromyography (EMG) signals have garnered widespread attention, particularly in fields such as rehabilitation medicine and smart prosthetics. However, traditional EMG-based gesture recognition methods face challenges, including insufficient accuracy and poor noise resistance when handling complex gestures and diverse scenarios. To address these challenges, this study proposes a lightweight gesture recognition network based on multimodal signal fusion, combining surface EMG and Acceleration (ACC) signals. The proposed model integrates Depthwise Separable Convolutions (DSC) and Gated Recursive Units (GRU) to achieve a lightweight design while maintaining recognition performance. Experimental results demonstrate that the proposed method achieves recognition accuracies of 92.03±3.28 % and 77.48±4.38 % on the NinaPro DB2 and DB5 datasets, respectively, outperforming other state-of-the-art methods in terms of efficiency and computational cost. Additionally, the fusion of multimodal data significantly enhances the recognition performance of dynamic gestures. This study provides new insights into the design of embedded, real-time gesture recognition systems and holds important practical implications.</div></div>","PeriodicalId":54638,"journal":{"name":"Pattern Recognition Letters","volume":"190 ","pages":"Pages 35-44"},"PeriodicalIF":3.9000,"publicationDate":"2025-02-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition Letters","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016786552500042X","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
With the advancement of human-computer interaction (HCI) technology, gesture recognition methods based on electromyography (EMG) signals have garnered widespread attention, particularly in fields such as rehabilitation medicine and smart prosthetics. However, traditional EMG-based gesture recognition methods face challenges, including insufficient accuracy and poor noise resistance when handling complex gestures and diverse scenarios. To address these challenges, this study proposes a lightweight gesture recognition network based on multimodal signal fusion, combining surface EMG and Acceleration (ACC) signals. The proposed model integrates Depthwise Separable Convolutions (DSC) and Gated Recursive Units (GRU) to achieve a lightweight design while maintaining recognition performance. Experimental results demonstrate that the proposed method achieves recognition accuracies of 92.03±3.28 % and 77.48±4.38 % on the NinaPro DB2 and DB5 datasets, respectively, outperforming other state-of-the-art methods in terms of efficiency and computational cost. Additionally, the fusion of multimodal data significantly enhances the recognition performance of dynamic gestures. This study provides new insights into the design of embedded, real-time gesture recognition systems and holds important practical implications.
期刊介绍:
Pattern Recognition Letters aims at rapid publication of concise articles of a broad interest in pattern recognition.
Subject areas include all the current fields of interest represented by the Technical Committees of the International Association of Pattern Recognition, and other developing themes involving learning and recognition.