基于YOLO和抓取检测深度神经网络的机器人抓取检测技术*

J. Yang, Ui-Kai Chen, Kai-Chu Chang, Ying-Jen Chen
{"title":"基于YOLO和抓取检测深度神经网络的机器人抓取检测技术*","authors":"J. Yang, Ui-Kai Chen, Kai-Chu Chang, Ying-Jen Chen","doi":"10.1109/ARIS50834.2020.9205791","DOIUrl":null,"url":null,"abstract":"This paper proposes a robotic grasp detection technique by integrating you only look once (YOLO) deep neural network (DNN) and a grasp detection DNN. In this world, there are many people who cannot move their own bodies. The reason may be an accident or physical deterioration. So we need to invest more human resources to assist their lives. With new technological advances, robots are gradually able to perfectly replicate human movements. Hence, we intend to design a remote-control fetching robot. The system combines internet of things (IoT) technology, and users can use intelligent devices to control this robot with robotic arm to get the items they want. This paper focus on detecting the grasp of robotic arm by integrating YOLO and grasp detection DNNs. At first, YOLO V-v3 is applied to achieve object detection. Then a robotic grasp detection DNN is proposed to detect the robotic grasp. After that, the point cloud information of this object is utilized to calculate the normal vector of the grasp position such that the robotic arm can fetch the target along the normal vector. Finally, experiment results are given to show the practicality of the proposed robotic grasp detection Technique.","PeriodicalId":423389,"journal":{"name":"2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"A Novel Robotic Grasp Detection Technique by Integrating YOLO and Grasp Detection Deep Neural Networks *\",\"authors\":\"J. Yang, Ui-Kai Chen, Kai-Chu Chang, Ying-Jen Chen\",\"doi\":\"10.1109/ARIS50834.2020.9205791\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper proposes a robotic grasp detection technique by integrating you only look once (YOLO) deep neural network (DNN) and a grasp detection DNN. In this world, there are many people who cannot move their own bodies. The reason may be an accident or physical deterioration. So we need to invest more human resources to assist their lives. With new technological advances, robots are gradually able to perfectly replicate human movements. Hence, we intend to design a remote-control fetching robot. The system combines internet of things (IoT) technology, and users can use intelligent devices to control this robot with robotic arm to get the items they want. This paper focus on detecting the grasp of robotic arm by integrating YOLO and grasp detection DNNs. At first, YOLO V-v3 is applied to achieve object detection. Then a robotic grasp detection DNN is proposed to detect the robotic grasp. After that, the point cloud information of this object is utilized to calculate the normal vector of the grasp position such that the robotic arm can fetch the target along the normal vector. Finally, experiment results are given to show the practicality of the proposed robotic grasp detection Technique.\",\"PeriodicalId\":423389,\"journal\":{\"name\":\"2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS)\",\"volume\":\"6 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ARIS50834.2020.9205791\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ARIS50834.2020.9205791","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

本文提出了一种将you only look once (YOLO)深度神经网络(DNN)与抓取检测深度神经网络相结合的机器人抓取检测技术。在这个世界上,有很多人无法移动自己的身体。原因可能是意外事故或身体恶化。所以我们需要投入更多的人力资源来帮助他们的生活。随着新技术的进步,机器人逐渐能够完美地复制人类的动作。因此,我们打算设计一个遥控抓取机器人。该系统结合了物联网(IoT)技术,用户可以使用智能设备控制机器人的机械臂,以获得他们想要的物品。本文将YOLO和抓取检测dnn相结合,对机械臂抓取进行检测。首先使用YOLO V-v3实现目标检测。然后提出了一种机器人抓取检测深度神经网络来检测机器人抓取。然后利用该目标的点云信息计算抓取位置的法向量,使机械臂沿着法向量获取目标。最后给出了实验结果,验证了所提机器人抓取检测技术的实用性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Novel Robotic Grasp Detection Technique by Integrating YOLO and Grasp Detection Deep Neural Networks *
This paper proposes a robotic grasp detection technique by integrating you only look once (YOLO) deep neural network (DNN) and a grasp detection DNN. In this world, there are many people who cannot move their own bodies. The reason may be an accident or physical deterioration. So we need to invest more human resources to assist their lives. With new technological advances, robots are gradually able to perfectly replicate human movements. Hence, we intend to design a remote-control fetching robot. The system combines internet of things (IoT) technology, and users can use intelligent devices to control this robot with robotic arm to get the items they want. This paper focus on detecting the grasp of robotic arm by integrating YOLO and grasp detection DNNs. At first, YOLO V-v3 is applied to achieve object detection. Then a robotic grasp detection DNN is proposed to detect the robotic grasp. After that, the point cloud information of this object is utilized to calculate the normal vector of the grasp position such that the robotic arm can fetch the target along the normal vector. Finally, experiment results are given to show the practicality of the proposed robotic grasp detection Technique.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信