Agastasya Dahiya;Dhruv Wadhwa;Rohan Katti;Luigi G. Occhipinti
{"title":"基于人工智能和基于imu的可穿戴设备的高效手势识别","authors":"Agastasya Dahiya;Dhruv Wadhwa;Rohan Katti;Luigi G. Occhipinti","doi":"10.1109/LSENS.2024.3501586","DOIUrl":null,"url":null,"abstract":"Gesture recognition is an important element of human–computer interaction that allows natural and intuitive communication in applications such as healthcare, rehabilitation, smart home environments, safety, gaming, and accessibility solutions for individuals with disabilities. The electromyography (EMG) and mechanomyography (MMG) sensor-based traditional approaches suffer from limitations such as noise susceptibility, critical placement requirements, and inefficient detection of broader arm movements. Further, they do not work for individuals with amputation or minimal muscle movement, as muscle activity is not available. Addressing these challenges, herein, we present a novel wearable hand gesture recognition system which is less prone to noise and placement issues. The presented devices use accelerometers and gyroscopes to capture hand and arm gestures. Further, the developed wearable system employs 1-D convolutional neural networks (1-D CNNs), long short-term memory, and recurrent neural networks for efficient processing of data and recognition of gestures. The 1-D CNN with three convolutional and three dense layers emerged as the optimal solution, achieving an accuracy of 97.88% with balanced inference time and memory usage. The study concludes that this model offers an optimal trade-off between model size and accuracy, making it highly suitable for resource-constrained wearable devices.","PeriodicalId":13014,"journal":{"name":"IEEE Sensors Letters","volume":"8 12","pages":"1-4"},"PeriodicalIF":2.2000,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Efficient Hand Gesture Recognition Using Artificial Intelligence and IMU-Based Wearable Device\",\"authors\":\"Agastasya Dahiya;Dhruv Wadhwa;Rohan Katti;Luigi G. Occhipinti\",\"doi\":\"10.1109/LSENS.2024.3501586\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Gesture recognition is an important element of human–computer interaction that allows natural and intuitive communication in applications such as healthcare, rehabilitation, smart home environments, safety, gaming, and accessibility solutions for individuals with disabilities. The electromyography (EMG) and mechanomyography (MMG) sensor-based traditional approaches suffer from limitations such as noise susceptibility, critical placement requirements, and inefficient detection of broader arm movements. Further, they do not work for individuals with amputation or minimal muscle movement, as muscle activity is not available. Addressing these challenges, herein, we present a novel wearable hand gesture recognition system which is less prone to noise and placement issues. The presented devices use accelerometers and gyroscopes to capture hand and arm gestures. Further, the developed wearable system employs 1-D convolutional neural networks (1-D CNNs), long short-term memory, and recurrent neural networks for efficient processing of data and recognition of gestures. The 1-D CNN with three convolutional and three dense layers emerged as the optimal solution, achieving an accuracy of 97.88% with balanced inference time and memory usage. The study concludes that this model offers an optimal trade-off between model size and accuracy, making it highly suitable for resource-constrained wearable devices.\",\"PeriodicalId\":13014,\"journal\":{\"name\":\"IEEE Sensors Letters\",\"volume\":\"8 12\",\"pages\":\"1-4\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2024-11-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Letters\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10758304/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Letters","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10758304/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Efficient Hand Gesture Recognition Using Artificial Intelligence and IMU-Based Wearable Device
Gesture recognition is an important element of human–computer interaction that allows natural and intuitive communication in applications such as healthcare, rehabilitation, smart home environments, safety, gaming, and accessibility solutions for individuals with disabilities. The electromyography (EMG) and mechanomyography (MMG) sensor-based traditional approaches suffer from limitations such as noise susceptibility, critical placement requirements, and inefficient detection of broader arm movements. Further, they do not work for individuals with amputation or minimal muscle movement, as muscle activity is not available. Addressing these challenges, herein, we present a novel wearable hand gesture recognition system which is less prone to noise and placement issues. The presented devices use accelerometers and gyroscopes to capture hand and arm gestures. Further, the developed wearable system employs 1-D convolutional neural networks (1-D CNNs), long short-term memory, and recurrent neural networks for efficient processing of data and recognition of gestures. The 1-D CNN with three convolutional and three dense layers emerged as the optimal solution, achieving an accuracy of 97.88% with balanced inference time and memory usage. The study concludes that this model offers an optimal trade-off between model size and accuracy, making it highly suitable for resource-constrained wearable devices.