Quadruped Robot Locomotion in Unknown Terrain Using Deep Reinforcement Learning

Muleilan Pei, Dongping Wu, Changhong Wang
{"title":"Quadruped Robot Locomotion in Unknown Terrain Using Deep Reinforcement Learning","authors":"Muleilan Pei, Dongping Wu, Changhong Wang","doi":"10.1109/ICUS50048.2020.9274920","DOIUrl":null,"url":null,"abstract":"This paper is concerned with locomotion problems for the quadruped robot in unknown and unstructured terrains, utilizing the emerging deep reinforcement learning technique. The state-of-the-art deep deterministic policy gradient (DDPG) algorithm is leveraged to acquire the gait policy by learning from interactions with the environment. The framework of learning system is presented based on the actor-critic architecture, and the additional domain-specific knowledge is exploited for shaping the reward function to enhance the learning efficiency during training. Moreover, a simulation study is implemented to validate the performance of the proposed DDPG-based controller.","PeriodicalId":110715,"journal":{"name":"2020 3rd International Conference on Unmanned Systems (ICUS)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 3rd International Conference on Unmanned Systems (ICUS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICUS50048.2020.9274920","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

This paper is concerned with locomotion problems for the quadruped robot in unknown and unstructured terrains, utilizing the emerging deep reinforcement learning technique. The state-of-the-art deep deterministic policy gradient (DDPG) algorithm is leveraged to acquire the gait policy by learning from interactions with the environment. The framework of learning system is presented based on the actor-critic architecture, and the additional domain-specific knowledge is exploited for shaping the reward function to enhance the learning efficiency during training. Moreover, a simulation study is implemented to validate the performance of the proposed DDPG-based controller.
基于深度强化学习的未知地形四足机器人运动
本文利用新兴的深度强化学习技术研究了四足机器人在未知和非结构化地形中的运动问题。利用最先进的深度确定性策略梯度(DDPG)算法,通过与环境的相互作用来学习步态策略。提出了基于行动者-评论家体系结构的学习系统框架,并利用额外的领域特定知识来形成奖励函数,以提高训练过程中的学习效率。通过仿真研究验证了所提出的基于ddpg的控制器的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书