Reinforcement Learning-Based Parallel Approach Control of Micro-Assembly Manipulators

Juan Zhang, Lie Bi, Wen-rong Wu, K. Du
{"title":"Reinforcement Learning-Based Parallel Approach Control of Micro-Assembly Manipulators","authors":"Juan Zhang, Lie Bi, Wen-rong Wu, K. Du","doi":"10.1109/ICCAE55086.2022.9762422","DOIUrl":null,"url":null,"abstract":"Micro-devices are usually assembled by micro-assembly robot operating multi-manipulators in a narrow assembly space. To ensure assembly accuracy, manipulators are required to assemble multiple parts in parallel. However, in the traditional assembly, in order to prevent the parts from interfering, the movement trajectory of each manipulator must be manually input, which leads to low planning efficiency. In this paper, a multi-body spatial approach algorithm is established based on reinforcement learning methods, and a multi-body collision avoidance control method based on grid method and reinforcement learning is proposed, which realizes the purpose of efficiently generating the running trajectory and improving the planning efficiency on the premise that multi-parts achieve the target pose without interference. In addition, the calibration method of the simulation space coordinate systems and the Cartesian space coordinate systems is proposed, the motion trajectory in simulation space is transformed into the Cartesian space motion trajectory to control manipulators movement. Experimental results verify the effectiveness of the proposed method, and realize intelligent and safe parallel approaching of multi-manipulators.","PeriodicalId":294641,"journal":{"name":"2022 14th International Conference on Computer and Automation Engineering (ICCAE)","volume":"134 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 14th International Conference on Computer and Automation Engineering (ICCAE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCAE55086.2022.9762422","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Micro-devices are usually assembled by micro-assembly robot operating multi-manipulators in a narrow assembly space. To ensure assembly accuracy, manipulators are required to assemble multiple parts in parallel. However, in the traditional assembly, in order to prevent the parts from interfering, the movement trajectory of each manipulator must be manually input, which leads to low planning efficiency. In this paper, a multi-body spatial approach algorithm is established based on reinforcement learning methods, and a multi-body collision avoidance control method based on grid method and reinforcement learning is proposed, which realizes the purpose of efficiently generating the running trajectory and improving the planning efficiency on the premise that multi-parts achieve the target pose without interference. In addition, the calibration method of the simulation space coordinate systems and the Cartesian space coordinate systems is proposed, the motion trajectory in simulation space is transformed into the Cartesian space motion trajectory to control manipulators movement. Experimental results verify the effectiveness of the proposed method, and realize intelligent and safe parallel approaching of multi-manipulators.
基于强化学习的微装配机械臂并行控制
微型装置通常由微型装配机器人在狭窄的装配空间内操作多机械手进行装配。为保证装配精度,要求机械手并联装配多个零件。然而,在传统的装配中,为了防止零件的干扰,必须手动输入每个机械手的运动轨迹,导致规划效率低。本文建立了一种基于强化学习方法的多体空间逼近算法,提出了一种基于网格法和强化学习的多体避碰控制方法,实现了在多部分互不干扰到达目标位姿的前提下高效生成运行轨迹,提高规划效率的目的。此外,提出了仿真空间坐标系与笛卡尔空间坐标系的标定方法,将仿真空间中的运动轨迹转换为笛卡尔空间运动轨迹来控制机械手的运动。实验结果验证了该方法的有效性,实现了多机械臂的智能安全并行逼近。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信