基于深度强化学习的封网机器人路径规划

Yang Mazan, Zhiqing Huang, Yi Zhang, Kai Ye, Yunlong Li
{"title":"基于深度强化学习的封网机器人路径规划","authors":"Yang Mazan, Zhiqing Huang, Yi Zhang, Kai Ye, Yunlong Li","doi":"10.1117/12.2680389","DOIUrl":null,"url":null,"abstract":"For the path planning problem of overhead transmission net sealing robot in the process of sealing network, a visual perception and decision method based on deep reinforcement learning is proposed. By combining the perceptual capability of convolutional neural networks with the decision-making capability of reinforcement learning, the method achieves direct output control from the visual perception input of the environment to the action through end-to-end learning, forming a closed loop between the system environment perception and decision control directly, and obtaining the optimal decision strategy by maximizing the cumulative reward return of the robot's interaction with the dynamical environment. Simulation experimental results prove that the method can meet the requirements of multi-task intelligent perception and decision making, and better solve the problems of traditional algorithms such as easily falling into local optimum, oscillating in narrow passages and unreachable targets near obstacles, which greatly improve the real-time and adaptability of trajectory tracking and dynamic obstacle avoidance of the net sealing robot and ensure the safe operation of the net sealing robot in transmission line sealing operations.","PeriodicalId":201466,"journal":{"name":"Symposium on Advances in Electrical, Electronics and Computer Engineering","volume":"77 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep reinforcement learning-based path planning for net sealing robot\",\"authors\":\"Yang Mazan, Zhiqing Huang, Yi Zhang, Kai Ye, Yunlong Li\",\"doi\":\"10.1117/12.2680389\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"For the path planning problem of overhead transmission net sealing robot in the process of sealing network, a visual perception and decision method based on deep reinforcement learning is proposed. By combining the perceptual capability of convolutional neural networks with the decision-making capability of reinforcement learning, the method achieves direct output control from the visual perception input of the environment to the action through end-to-end learning, forming a closed loop between the system environment perception and decision control directly, and obtaining the optimal decision strategy by maximizing the cumulative reward return of the robot's interaction with the dynamical environment. Simulation experimental results prove that the method can meet the requirements of multi-task intelligent perception and decision making, and better solve the problems of traditional algorithms such as easily falling into local optimum, oscillating in narrow passages and unreachable targets near obstacles, which greatly improve the real-time and adaptability of trajectory tracking and dynamic obstacle avoidance of the net sealing robot and ensure the safe operation of the net sealing robot in transmission line sealing operations.\",\"PeriodicalId\":201466,\"journal\":{\"name\":\"Symposium on Advances in Electrical, Electronics and Computer Engineering\",\"volume\":\"77 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Symposium on Advances in Electrical, Electronics and Computer Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2680389\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Symposium on Advances in Electrical, Electronics and Computer Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2680389","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

针对架空输电网封网机器人在封网过程中的路径规划问题,提出了一种基于深度强化学习的视觉感知与决策方法。该方法将卷积神经网络的感知能力与强化学习的决策能力相结合,通过端到端学习实现从环境的视觉感知输入到动作的直接输出控制,在系统环境感知与决策控制之间直接形成闭环。并通过最大化机器人与动态环境相互作用的累计回报来获得最优决策策略。仿真实验结果证明,该方法能够满足多任务智能感知和决策的要求,较好地解决了传统算法容易陷入局部最优、在狭窄通道中振荡、障碍物附近目标难以到达等问题。大大提高了封网机器人轨迹跟踪和动态避障的实时性和适应性,保证了封网机器人在输电线路封网作业中的安全运行。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep reinforcement learning-based path planning for net sealing robot
For the path planning problem of overhead transmission net sealing robot in the process of sealing network, a visual perception and decision method based on deep reinforcement learning is proposed. By combining the perceptual capability of convolutional neural networks with the decision-making capability of reinforcement learning, the method achieves direct output control from the visual perception input of the environment to the action through end-to-end learning, forming a closed loop between the system environment perception and decision control directly, and obtaining the optimal decision strategy by maximizing the cumulative reward return of the robot's interaction with the dynamical environment. Simulation experimental results prove that the method can meet the requirements of multi-task intelligent perception and decision making, and better solve the problems of traditional algorithms such as easily falling into local optimum, oscillating in narrow passages and unreachable targets near obstacles, which greatly improve the real-time and adaptability of trajectory tracking and dynamic obstacle avoidance of the net sealing robot and ensure the safe operation of the net sealing robot in transmission line sealing operations.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信