Grasping Unknown Objects With Only One Demonstration

IF 4.6 2区 计算机科学 Q2 ROBOTICS
Yanghong Li;Haiyang He;Jin Chai;Guangrui Bai;Erbao Dong
{"title":"Grasping Unknown Objects With Only One Demonstration","authors":"Yanghong Li;Haiyang He;Jin Chai;Guangrui Bai;Erbao Dong","doi":"10.1109/LRA.2024.3513037","DOIUrl":null,"url":null,"abstract":"The combination of imitation learning and reinforcement learning is expected to solve the challenge of grasping unknown objects with anthropomorphic hand-arm systems. However, this method requires a large number of perfect demonstrations and the implementation in real robots often differs greatly from the simulation effect. In this work, we introduce a curriculum learning mechanism and propose a multifinger grasping learning method that requires only one demonstration. First, a human remotely manipulates the robot via a wearable device to perform a successful grasping demonstration. The state of the object and the robot is recorded as the initial reference trajectory for reinforcement learning training. Then, by combining robot proprioception and the point cloud features of the target object, a multimodal deep reinforcement learning agent generates corrective actions for the reference demonstration in the synergy subspace of grasping and trains in simulation environments. Meanwhile, considering the topological and geometric variations of different objects, we establish a learning curriculum for objects to gradually improve the generalization ability of the agent, starting from similar to unknown objects. Finally, only successfully trained models are deployed on real robots. Compared to the baseline method, our method reduces dependence on the grasping data set while improving learning efficiency. Our success rate for grasping novel objects is higher.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 2","pages":"987-994"},"PeriodicalIF":4.6000,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Robotics and Automation Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10783000/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

The combination of imitation learning and reinforcement learning is expected to solve the challenge of grasping unknown objects with anthropomorphic hand-arm systems. However, this method requires a large number of perfect demonstrations and the implementation in real robots often differs greatly from the simulation effect. In this work, we introduce a curriculum learning mechanism and propose a multifinger grasping learning method that requires only one demonstration. First, a human remotely manipulates the robot via a wearable device to perform a successful grasping demonstration. The state of the object and the robot is recorded as the initial reference trajectory for reinforcement learning training. Then, by combining robot proprioception and the point cloud features of the target object, a multimodal deep reinforcement learning agent generates corrective actions for the reference demonstration in the synergy subspace of grasping and trains in simulation environments. Meanwhile, considering the topological and geometric variations of different objects, we establish a learning curriculum for objects to gradually improve the generalization ability of the agent, starting from similar to unknown objects. Finally, only successfully trained models are deployed on real robots. Compared to the baseline method, our method reduces dependence on the grasping data set while improving learning efficiency. Our success rate for grasping novel objects is higher.
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Robotics and Automation Letters
IEEE Robotics and Automation Letters Computer Science-Computer Science Applications
CiteScore
9.60
自引率
15.40%
发文量
1428
期刊介绍: The scope of this journal is to publish peer-reviewed articles that provide a timely and concise account of innovative research ideas and application results, reporting significant theoretical findings and application case studies in areas of robotics and automation.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信