Jia Zhang, Tao Geng, Huan Shi, Danyang Wang, Jiangtao Lu
{"title":"基于YCbCr和SURF的服务机器人交互手势识别方法","authors":"Jia Zhang, Tao Geng, Huan Shi, Danyang Wang, Jiangtao Lu","doi":"10.1109/ICRAE53653.2021.9657803","DOIUrl":null,"url":null,"abstract":"With the increasing requirements of human-computer interaction experience, gesture recognition is used in many applications as a novel interaction method. However, the effects of complex backgrounds, occlusions and illumination pose difficulties for the successful recognition of gestures. For this problem, we propose a gesture recognition method based on the combination of SURF and YcbCr. First, RGB-D was calibrated, and then the collected hand images were processed for noise reduction. Secondly, the coarse recognition of gestures is completed by SURF feature point matching algorithm, and then the fine recognition of gestures is achieved by YCbCr skin tone segmentation algorithm. Finally, the gesture images are further processed by a combined morphological algorithm to improve the integrity of gesture recognition and reduce the influence of interfering factors. The experimental results show that the method can recognize gestures quickly and effectively with certain accuracy and robustness.","PeriodicalId":338398,"journal":{"name":"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Gesture Recognition Method Based on YCbCr and SURF for Service Robot Interaction\",\"authors\":\"Jia Zhang, Tao Geng, Huan Shi, Danyang Wang, Jiangtao Lu\",\"doi\":\"10.1109/ICRAE53653.2021.9657803\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the increasing requirements of human-computer interaction experience, gesture recognition is used in many applications as a novel interaction method. However, the effects of complex backgrounds, occlusions and illumination pose difficulties for the successful recognition of gestures. For this problem, we propose a gesture recognition method based on the combination of SURF and YcbCr. First, RGB-D was calibrated, and then the collected hand images were processed for noise reduction. Secondly, the coarse recognition of gestures is completed by SURF feature point matching algorithm, and then the fine recognition of gestures is achieved by YCbCr skin tone segmentation algorithm. Finally, the gesture images are further processed by a combined morphological algorithm to improve the integrity of gesture recognition and reduce the influence of interfering factors. The experimental results show that the method can recognize gestures quickly and effectively with certain accuracy and robustness.\",\"PeriodicalId\":338398,\"journal\":{\"name\":\"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-11-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICRAE53653.2021.9657803\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICRAE53653.2021.9657803","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Gesture Recognition Method Based on YCbCr and SURF for Service Robot Interaction
With the increasing requirements of human-computer interaction experience, gesture recognition is used in many applications as a novel interaction method. However, the effects of complex backgrounds, occlusions and illumination pose difficulties for the successful recognition of gestures. For this problem, we propose a gesture recognition method based on the combination of SURF and YcbCr. First, RGB-D was calibrated, and then the collected hand images were processed for noise reduction. Secondly, the coarse recognition of gestures is completed by SURF feature point matching algorithm, and then the fine recognition of gestures is achieved by YCbCr skin tone segmentation algorithm. Finally, the gesture images are further processed by a combined morphological algorithm to improve the integrity of gesture recognition and reduce the influence of interfering factors. The experimental results show that the method can recognize gestures quickly and effectively with certain accuracy and robustness.