Robotic Grasping in Simulation Using Deep Reinforcement Learning

Musab Coskun, Ozal Yildirim, Y. Demir
{"title":"Robotic Grasping in Simulation Using Deep Reinforcement Learning","authors":"Musab Coskun, Ozal Yildirim, Y. Demir","doi":"10.1109/UBMK55850.2022.9919482","DOIUrl":null,"url":null,"abstract":"In robotics, manipulators are recently becoming one of the prominent fields of interest for different types of applications. One of the usual functionalities performed by manipulators is grasping. Grasping means simply holding an object. In order to perform a grasping task, each manipulator needs a gripper mounted at the end effector of them. In this paper, a method based on deep reinforcement learning is presented to deal with the issue of robotic grasping employing only vision feedback. The combination of deep learning with dueling architecture, a variant of Q-learning, brings the complexity caused by the use of handcrafted features to a humbler state. Our method employs the Dueling Deep Q-learning Network(DDQN) to learn the grasping policy. Our proposed system employs a visual structure that uses a Kinect camera setup that spots the scene that possesses the object of interest. We realized our experiments by utilizing Webots simulator environment. The results show that our proposed dueling architecture enables our Reinforcement Learning(RL) agent to perform well enough to fulfill the grasping task.","PeriodicalId":417604,"journal":{"name":"2022 7th International Conference on Computer Science and Engineering (UBMK)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 7th International Conference on Computer Science and Engineering (UBMK)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/UBMK55850.2022.9919482","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In robotics, manipulators are recently becoming one of the prominent fields of interest for different types of applications. One of the usual functionalities performed by manipulators is grasping. Grasping means simply holding an object. In order to perform a grasping task, each manipulator needs a gripper mounted at the end effector of them. In this paper, a method based on deep reinforcement learning is presented to deal with the issue of robotic grasping employing only vision feedback. The combination of deep learning with dueling architecture, a variant of Q-learning, brings the complexity caused by the use of handcrafted features to a humbler state. Our method employs the Dueling Deep Q-learning Network(DDQN) to learn the grasping policy. Our proposed system employs a visual structure that uses a Kinect camera setup that spots the scene that possesses the object of interest. We realized our experiments by utilizing Webots simulator environment. The results show that our proposed dueling architecture enables our Reinforcement Learning(RL) agent to perform well enough to fulfill the grasping task.
基于深度强化学习的机器人抓取仿真
在机器人技术中,操纵器最近成为不同类型应用的突出领域之一。机械手通常执行的功能之一是抓取。抓取意味着简单地握住一个物体。为了执行抓取任务,每个机械手都需要在其末端执行器上安装一个夹持器。本文提出了一种基于深度强化学习的方法来解决仅使用视觉反馈的机器人抓取问题。深度学习与决斗架构(Q-learning的一种变体)的结合,将使用手工特征所带来的复杂性降至较低的状态。我们的方法采用Dueling深度Q-learning Network(DDQN)来学习抓取策略。我们提出的系统采用了一种视觉结构,使用Kinect摄像头设置来发现拥有感兴趣对象的场景。我们利用Webots模拟器环境来实现我们的实验。结果表明,我们提出的决斗架构使我们的强化学习(RL)智能体能够很好地完成抓取任务。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信