Perception-Driven Learning of High-Dynamic Jumping Motions for Single-Legged Robots

IF 4.9 3区 计算机科学 Q1 ENGINEERING, MULTIDISCIPLINARY
Nengxiang Sun, Fei Meng, Sai Gu, Botao Liu, Xuechao Chen, Zhangguo Yu, Qiang Huang
{"title":"Perception-Driven Learning of High-Dynamic Jumping Motions for Single-Legged Robots","authors":"Nengxiang Sun,&nbsp;Fei Meng,&nbsp;Sai Gu,&nbsp;Botao Liu,&nbsp;Xuechao Chen,&nbsp;Zhangguo Yu,&nbsp;Qiang Huang","doi":"10.1007/s42235-024-00541-3","DOIUrl":null,"url":null,"abstract":"<div><p>Legged robots show great potential for high-dynamic motions in continuous interaction with the physical environment, yet achieving animal-like agility remains significant challenges. Legged animals usually predict and plan their next locomotion by combining high-dimensional information from proprioception and exteroception, and adjust the stiffness of the body’s skeletal muscle system to adapt to the current environment. Traditional control methods have limitations in handling high-dimensional state information or complex robot motion that are difficult to plan manually, and Deep Reinforcement Learning (DRL) algorithms provide new solutions to robot motioncontrol problems. Inspired by biomimetics theory, we propose a perception-driven high-dynamic jump adaptive learning algorithm by combining DRL algorithms with Virtual Model Control (VMC) method. The robot will be fully trained in simulation to explore its motion potential by learning the factors related to continuous jumping while knowing its real-time jumping height. The policy trained in simulation is successfully deployed on the bio-inspired single-legged robot testing platform without further adjustments. Experimental results show that the robot can achieve continuous and ideal vertical jumping motion through simple training</p></div>","PeriodicalId":614,"journal":{"name":"Journal of Bionic Engineering","volume":"21 4","pages":"1733 - 1746"},"PeriodicalIF":4.9000,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Bionic Engineering","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s42235-024-00541-3","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Legged robots show great potential for high-dynamic motions in continuous interaction with the physical environment, yet achieving animal-like agility remains significant challenges. Legged animals usually predict and plan their next locomotion by combining high-dimensional information from proprioception and exteroception, and adjust the stiffness of the body’s skeletal muscle system to adapt to the current environment. Traditional control methods have limitations in handling high-dimensional state information or complex robot motion that are difficult to plan manually, and Deep Reinforcement Learning (DRL) algorithms provide new solutions to robot motioncontrol problems. Inspired by biomimetics theory, we propose a perception-driven high-dynamic jump adaptive learning algorithm by combining DRL algorithms with Virtual Model Control (VMC) method. The robot will be fully trained in simulation to explore its motion potential by learning the factors related to continuous jumping while knowing its real-time jumping height. The policy trained in simulation is successfully deployed on the bio-inspired single-legged robot testing platform without further adjustments. Experimental results show that the robot can achieve continuous and ideal vertical jumping motion through simple training

Abstract Image

单腿机器人高动态跳跃动作的感知驱动学习
在与物理环境的持续互动中,腿部机器人在高动态运动方面展现出巨大潜力,但要实现动物般的敏捷性仍是一项重大挑战。有腿动物通常通过结合本体感觉和外部感觉的高维信息来预测和规划下一步运动,并调整身体骨骼肌系统的硬度以适应当前环境。传统的控制方法在处理人工难以规划的高维状态信息或复杂机器人运动时存在局限性,而深度强化学习(DRL)算法为机器人运动控制问题提供了新的解决方案。受生物仿生学理论的启发,我们将 DRL 算法与虚拟模型控制(VMC)方法相结合,提出了一种感知驱动的高动态跃迁自适应学习算法。在了解机器人实时跳跃高度的同时,通过学习与连续跳跃相关的因素,机器人将在仿真中接受全面训练,以挖掘其运动潜力。仿真训练后的策略无需进一步调整,即可成功部署到生物启发单足机器人测试平台上。实验结果表明,通过简单的训练,机器人可以实现理想的连续垂直跳跃运动。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Bionic Engineering
Journal of Bionic Engineering 工程技术-材料科学:生物材料
CiteScore
7.10
自引率
10.00%
发文量
162
审稿时长
10.0 months
期刊介绍: The Journal of Bionic Engineering (JBE) is a peer-reviewed journal that publishes original research papers and reviews that apply the knowledge learned from nature and biological systems to solve concrete engineering problems. The topics that JBE covers include but are not limited to: Mechanisms, kinematical mechanics and control of animal locomotion, development of mobile robots with walking (running and crawling), swimming or flying abilities inspired by animal locomotion. Structures, morphologies, composition and physical properties of natural and biomaterials; fabrication of new materials mimicking the properties and functions of natural and biomaterials. Biomedical materials, artificial organs and tissue engineering for medical applications; rehabilitation equipment and devices. Development of bioinspired computation methods and artificial intelligence for engineering applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信