{"title":"Robotic Grasping in Simulation Using Deep Reinforcement Learning","authors":"Musab Coskun, Ozal Yildirim, Y. Demir","doi":"10.1109/UBMK55850.2022.9919482","DOIUrl":null,"url":null,"abstract":"In robotics, manipulators are recently becoming one of the prominent fields of interest for different types of applications. One of the usual functionalities performed by manipulators is grasping. Grasping means simply holding an object. In order to perform a grasping task, each manipulator needs a gripper mounted at the end effector of them. In this paper, a method based on deep reinforcement learning is presented to deal with the issue of robotic grasping employing only vision feedback. The combination of deep learning with dueling architecture, a variant of Q-learning, brings the complexity caused by the use of handcrafted features to a humbler state. Our method employs the Dueling Deep Q-learning Network(DDQN) to learn the grasping policy. Our proposed system employs a visual structure that uses a Kinect camera setup that spots the scene that possesses the object of interest. We realized our experiments by utilizing Webots simulator environment. The results show that our proposed dueling architecture enables our Reinforcement Learning(RL) agent to perform well enough to fulfill the grasping task.","PeriodicalId":417604,"journal":{"name":"2022 7th International Conference on Computer Science and Engineering (UBMK)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 7th International Conference on Computer Science and Engineering (UBMK)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/UBMK55850.2022.9919482","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In robotics, manipulators are recently becoming one of the prominent fields of interest for different types of applications. One of the usual functionalities performed by manipulators is grasping. Grasping means simply holding an object. In order to perform a grasping task, each manipulator needs a gripper mounted at the end effector of them. In this paper, a method based on deep reinforcement learning is presented to deal with the issue of robotic grasping employing only vision feedback. The combination of deep learning with dueling architecture, a variant of Q-learning, brings the complexity caused by the use of handcrafted features to a humbler state. Our method employs the Dueling Deep Q-learning Network(DDQN) to learn the grasping policy. Our proposed system employs a visual structure that uses a Kinect camera setup that spots the scene that possesses the object of interest. We realized our experiments by utilizing Webots simulator environment. The results show that our proposed dueling architecture enables our Reinforcement Learning(RL) agent to perform well enough to fulfill the grasping task.