Yazan M. Dweiri, Mohammad M. AlAjlouni, Jawdat R. Ayoub, Alaa Y. Al-Zeer, Ali H. Hejazi
{"title":"基于深度学习的机械手仿生抓取控制","authors":"Yazan M. Dweiri, Mohammad M. AlAjlouni, Jawdat R. Ayoub, Alaa Y. Al-Zeer, Ali H. Hejazi","doi":"10.1109/JEEIT58638.2023.10185845","DOIUrl":null,"url":null,"abstract":"Gripping force modulation based on pressure feedback is an essential element for intuitive and natural-like control of powered limb prostheses. This paper aims to mimic human hand-gripping control in robotic arms by processing dynamic pressure maps with state-of-the-art artificial intelligence algorithms. A pressure-sensing glove was built with integrated data acquisition to learn human grip behavior when holding various objects, and then transfer the observed control pattern to control a robotic arm. The pressure readings are processed using a recurrent convolutional neural network and were able to predict the biological gripping termination with an accuracy of 84.5% for a single type of object and 77% for mixed object types. The proposed control system has proven to be a viable approach for biomimetic handling control for an intelligent robotic arm with pressure feedback.","PeriodicalId":177556,"journal":{"name":"2023 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Biomimetic Grasp Control of Robotic Hands Using Deep Learning\",\"authors\":\"Yazan M. Dweiri, Mohammad M. AlAjlouni, Jawdat R. Ayoub, Alaa Y. Al-Zeer, Ali H. Hejazi\",\"doi\":\"10.1109/JEEIT58638.2023.10185845\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Gripping force modulation based on pressure feedback is an essential element for intuitive and natural-like control of powered limb prostheses. This paper aims to mimic human hand-gripping control in robotic arms by processing dynamic pressure maps with state-of-the-art artificial intelligence algorithms. A pressure-sensing glove was built with integrated data acquisition to learn human grip behavior when holding various objects, and then transfer the observed control pattern to control a robotic arm. The pressure readings are processed using a recurrent convolutional neural network and were able to predict the biological gripping termination with an accuracy of 84.5% for a single type of object and 77% for mixed object types. The proposed control system has proven to be a viable approach for biomimetic handling control for an intelligent robotic arm with pressure feedback.\",\"PeriodicalId\":177556,\"journal\":{\"name\":\"2023 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/JEEIT58638.2023.10185845\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/JEEIT58638.2023.10185845","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Biomimetic Grasp Control of Robotic Hands Using Deep Learning
Gripping force modulation based on pressure feedback is an essential element for intuitive and natural-like control of powered limb prostheses. This paper aims to mimic human hand-gripping control in robotic arms by processing dynamic pressure maps with state-of-the-art artificial intelligence algorithms. A pressure-sensing glove was built with integrated data acquisition to learn human grip behavior when holding various objects, and then transfer the observed control pattern to control a robotic arm. The pressure readings are processed using a recurrent convolutional neural network and were able to predict the biological gripping termination with an accuracy of 84.5% for a single type of object and 77% for mixed object types. The proposed control system has proven to be a viable approach for biomimetic handling control for an intelligent robotic arm with pressure feedback.