Advances in legged robots control, perception and learning

IF 1.5 Q3 AUTOMATION & CONTROL SYSTEMS
Qiuguo Zhu, Rui Song, Jun Wu, Yamakita Masaki, Zhangguo Yu
{"title":"Advances in legged robots control, perception and learning","authors":"Qiuguo Zhu,&nbsp;Rui Song,&nbsp;Jun Wu,&nbsp;Yamakita Masaki,&nbsp;Zhangguo Yu","doi":"10.1049/csy2.12075","DOIUrl":null,"url":null,"abstract":"<p>This is the Institution of Engineering and Technology (IET) Cyber-systems and Robotics Special Issue of Advances in Legged Robots: Control, Perception and Learning.</p><p>Legged mammals are found everywhere in nature. These legged animals can reach anywhere on Earth, adapt to uneven, discontinuous and obstructed environment. Their locomotion patterns are flexible and diverse to better adapt to the living environment. Imitating these real animals, legged robots have potential advantages over wheeled or tracked vehicles in regard to the traversal of rough and unstructured terrain. However, there are still many challenges for legged systems in solving the technical problems of the real world.</p><p>Control, perception and learning are the key technologies in the field of legged robots. Control is the basis of the stable and flexible locomotion of the legged robot. The combination of control and mechatronics machines will show excellent passing ability in continuous stairs, discrete terrain and vertical obstacle environments. The control methods of legged robots mainly include model-based control and learning-based control. After decades of development, research results have made robots more flexible and stable. The latter is a new method combining artificial intelligence, exploring how robots can acquire new motor skills in the process of interacting with the environment and achieve expected motor abilities. Perception allows the robot to understand the world. Autonomous navigation, behavioural decision-making and task operation, all require environmental awareness and understanding. This ability is an unattainable component of the legged robot. For example, different road surfaces require different gait modes, which is the most direct perceptual demand for legged robots.</p><p>Paper 1 by Haochen Xu, paper 2 by Qiuyue Luo and paper 3 by Wenhan Cai investigated the control problems of biped robots, paper 4 by Linqi Ye studied the leg–arm and wheel reconfiguration design and control strategy problems and paper 5 by Jinmian Hou extended the multi-leg hexapod robot problems. The design, control and strategy of the legged robot are discussed.</p><p>In paper 1, Haochen Xu et al. studied the disturbance rejection for biped robots during walking and running using CMG. They used the CMG as an auxiliary stabilisation device for fully actuated biped robots and integrated the CMG into the balance control framework. This method can effectively help the robot resist disturbance and remain stable over time.</p><p>In paper 2, Qiuyue Luo et al. exploited a self-stabilised walking gait for humanoid robots based on the essential model with internal states. They extended an essential dynamic model to the full dynamic model of humanoid robots based on the zero dynamics concept. By adjusting the step timing and landing position of the swing foot automatically and following the intrinsic dynamic characteristics, the humanoid robot can achieve robust walking.</p><p>In paper 3, Wenhan Cai et al. proposed the squat motion of a bipedal robot using RKP and whole-body control. The RKP method considers upcoming reference motion trajectories and combines it with quadratic programming (QP)-based whole body control (WBC). It greatly reduces the computational cost compared to model predictive control with WBC and exhibits high adaptability to rough planning with much less computation time.</p><p>In paper 4, Linqi Ye et al. designed a robotic system with legs, wheels and a reconfigurable arm, which takes advantage of the wheel and legs. In this robotic system, a leg–arm reconfiguration design allows the robot to walk, reducing the total weight of the robot, and the multi-task control strategy was described based on variable configuration to complicate environments.</p><p>In paper 5, Jinmian Hou et al. introduced a novel heuristic whole-body motion control framework for the heavy-duty hexapod robot to traverse complex terrain. They designed a whole-body motion planning and whole-body torque controller, and virtual model control was used to optimise the ground reaction forces for tracking the pre-planned motion based on single rigid-body dynamics.</p><p>Paper 6 by Zhicheng Wang et al. investigated the deep reinforcement learning (DRL) problem, while paper 7 by Chaoyue Xu et al. studied the neural network control problem. Both are essential aspects of learning to achieve control. The DRL approach can help learn robust and variety gaits more efficiently and better terrain adaptation. The neural network can help improve the dynamic performance of non-linear actuators.</p><p>In paper 6, Zhicheng Wang et al. proposed the efficient learning of robust quadruped bounding using pretrained neural networks. In their method, they designed a reward function to enforce the gait symmetry and periodicity to improve the bounding performance and learnt feedback controller by simulation where they can build variety of environments for simulation learning. This method has been deployed on the real quadruped robot.</p><p>In paper 7, Chaoyue Xu et al. described a new control for a PM bionic legged robot based on the neural network. In their method, a double closed-loop control strategy of the PM bionic leg was designed. Based on the three-element model, a feedforward neuron proportion-integral-derivative controller is designed as the inner control loop, and a sliding mode robust controller with local model approximation is designed using the radial basis function neural network as the outer control loop.</p><p>Paper 8 by Guangyu Fan et al. investigated the SLAM problem in dynamic environments, while paper 9 by Jiamin Guo et al. studied autonomous recognition and navigation problems. Both are essential aspects of perception. The SLAM method can help improve the robustness of localization, enabling navigation tasks in dynamic environments. Additionally, the autonomous recognition and navigation method can help understand the environment, make decisions and move to destinations.</p><p>In paper 8, Guangyu Fan et al. proposed sampling visual SLAM with a wide-angle camera for legged robots. Their method sampled image blocks with clear texture and enhanced the image details to extract the feature points, and the matched feature points were extracted from the images. These points were selected as the template points, the relationship between the template points and the images was established through the wide-angle camera model, and the pixel coordinates of the template in the images and the descriptors were calculated.</p><p>In paper 9, Jiamin Guo et al. researched a quadruped robot with a manipulator to realise leader-following, object recognition, navigation and operation. In this paper, the authors developed a systematic solution including the hardware and software system and system architecture. This can achieve recognition, autonomous navigation and operation on a quadruped robot with a manipulator, and it can be extended to other forms of mobile robots.</p><p>All of the papers selected for this special issue indicate trends in the emerging field of control, perception and learning in legged robots. We hope that this special issue will benefit researchers around the world by exchanging and sharing the latest results.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"4 4","pages":"265-267"},"PeriodicalIF":1.5000,"publicationDate":"2022-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12075","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Cybersystems and Robotics","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/csy2.12075","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

This is the Institution of Engineering and Technology (IET) Cyber-systems and Robotics Special Issue of Advances in Legged Robots: Control, Perception and Learning.

Legged mammals are found everywhere in nature. These legged animals can reach anywhere on Earth, adapt to uneven, discontinuous and obstructed environment. Their locomotion patterns are flexible and diverse to better adapt to the living environment. Imitating these real animals, legged robots have potential advantages over wheeled or tracked vehicles in regard to the traversal of rough and unstructured terrain. However, there are still many challenges for legged systems in solving the technical problems of the real world.

Control, perception and learning are the key technologies in the field of legged robots. Control is the basis of the stable and flexible locomotion of the legged robot. The combination of control and mechatronics machines will show excellent passing ability in continuous stairs, discrete terrain and vertical obstacle environments. The control methods of legged robots mainly include model-based control and learning-based control. After decades of development, research results have made robots more flexible and stable. The latter is a new method combining artificial intelligence, exploring how robots can acquire new motor skills in the process of interacting with the environment and achieve expected motor abilities. Perception allows the robot to understand the world. Autonomous navigation, behavioural decision-making and task operation, all require environmental awareness and understanding. This ability is an unattainable component of the legged robot. For example, different road surfaces require different gait modes, which is the most direct perceptual demand for legged robots.

Paper 1 by Haochen Xu, paper 2 by Qiuyue Luo and paper 3 by Wenhan Cai investigated the control problems of biped robots, paper 4 by Linqi Ye studied the leg–arm and wheel reconfiguration design and control strategy problems and paper 5 by Jinmian Hou extended the multi-leg hexapod robot problems. The design, control and strategy of the legged robot are discussed.

In paper 1, Haochen Xu et al. studied the disturbance rejection for biped robots during walking and running using CMG. They used the CMG as an auxiliary stabilisation device for fully actuated biped robots and integrated the CMG into the balance control framework. This method can effectively help the robot resist disturbance and remain stable over time.

In paper 2, Qiuyue Luo et al. exploited a self-stabilised walking gait for humanoid robots based on the essential model with internal states. They extended an essential dynamic model to the full dynamic model of humanoid robots based on the zero dynamics concept. By adjusting the step timing and landing position of the swing foot automatically and following the intrinsic dynamic characteristics, the humanoid robot can achieve robust walking.

In paper 3, Wenhan Cai et al. proposed the squat motion of a bipedal robot using RKP and whole-body control. The RKP method considers upcoming reference motion trajectories and combines it with quadratic programming (QP)-based whole body control (WBC). It greatly reduces the computational cost compared to model predictive control with WBC and exhibits high adaptability to rough planning with much less computation time.

In paper 4, Linqi Ye et al. designed a robotic system with legs, wheels and a reconfigurable arm, which takes advantage of the wheel and legs. In this robotic system, a leg–arm reconfiguration design allows the robot to walk, reducing the total weight of the robot, and the multi-task control strategy was described based on variable configuration to complicate environments.

In paper 5, Jinmian Hou et al. introduced a novel heuristic whole-body motion control framework for the heavy-duty hexapod robot to traverse complex terrain. They designed a whole-body motion planning and whole-body torque controller, and virtual model control was used to optimise the ground reaction forces for tracking the pre-planned motion based on single rigid-body dynamics.

Paper 6 by Zhicheng Wang et al. investigated the deep reinforcement learning (DRL) problem, while paper 7 by Chaoyue Xu et al. studied the neural network control problem. Both are essential aspects of learning to achieve control. The DRL approach can help learn robust and variety gaits more efficiently and better terrain adaptation. The neural network can help improve the dynamic performance of non-linear actuators.

In paper 6, Zhicheng Wang et al. proposed the efficient learning of robust quadruped bounding using pretrained neural networks. In their method, they designed a reward function to enforce the gait symmetry and periodicity to improve the bounding performance and learnt feedback controller by simulation where they can build variety of environments for simulation learning. This method has been deployed on the real quadruped robot.

In paper 7, Chaoyue Xu et al. described a new control for a PM bionic legged robot based on the neural network. In their method, a double closed-loop control strategy of the PM bionic leg was designed. Based on the three-element model, a feedforward neuron proportion-integral-derivative controller is designed as the inner control loop, and a sliding mode robust controller with local model approximation is designed using the radial basis function neural network as the outer control loop.

Paper 8 by Guangyu Fan et al. investigated the SLAM problem in dynamic environments, while paper 9 by Jiamin Guo et al. studied autonomous recognition and navigation problems. Both are essential aspects of perception. The SLAM method can help improve the robustness of localization, enabling navigation tasks in dynamic environments. Additionally, the autonomous recognition and navigation method can help understand the environment, make decisions and move to destinations.

In paper 8, Guangyu Fan et al. proposed sampling visual SLAM with a wide-angle camera for legged robots. Their method sampled image blocks with clear texture and enhanced the image details to extract the feature points, and the matched feature points were extracted from the images. These points were selected as the template points, the relationship between the template points and the images was established through the wide-angle camera model, and the pixel coordinates of the template in the images and the descriptors were calculated.

In paper 9, Jiamin Guo et al. researched a quadruped robot with a manipulator to realise leader-following, object recognition, navigation and operation. In this paper, the authors developed a systematic solution including the hardware and software system and system architecture. This can achieve recognition, autonomous navigation and operation on a quadruped robot with a manipulator, and it can be extended to other forms of mobile robots.

All of the papers selected for this special issue indicate trends in the emerging field of control, perception and learning in legged robots. We hope that this special issue will benefit researchers around the world by exchanging and sharing the latest results.

腿式机器人控制、感知和学习研究进展
这是工程与技术学会(IET)的网络系统与机器人技术特刊:腿式机器人的进展:控制、感知和学习。有腿的哺乳动物在自然界中随处可见。这些有腿的动物可以到达地球上的任何地方,适应不平坦、不连续和受阻的环境。它们的运动方式灵活多样,以更好地适应生活环境。模仿这些真实的动物,腿机器人在穿越粗糙和非结构化地形方面比轮式或履带式车辆具有潜在的优势。然而,在解决现实世界的技术问题时,腿式系统仍然面临许多挑战。控制、感知和学习是腿式机器人领域的关键技术。控制是腿式机器人稳定灵活运动的基础。控制与机电一体化相结合的机器将在连续楼梯、离散地形和垂直障碍环境中表现出优异的通过能力。腿式机器人的控制方法主要包括基于模型的控制和基于学习的控制。经过几十年的发展,研究成果使机器人更加灵活和稳定。后者是一种结合人工智能的新方法,探索机器人如何在与环境相互作用的过程中获得新的运动技能,达到预期的运动能力。感知能力使机器人能够理解世界。自主导航,行为决策和任务操作,都需要环境意识和理解。这种能力是有腿机器人无法实现的。例如,不同的路面需要不同的步态模式,这是对有腿机器人最直接的感知需求。论文1徐皓晨、论文2罗秋月、论文3蔡文汉研究了双足机器人的控制问题,论文4叶林琪研究了腿臂和车轮重构设计与控制策略问题,论文5侯金勉对多腿六足机器人问题进行了扩展。讨论了腿式机器人的设计、控制和策略。论文1中,Haochen Xu等人利用CMG研究了双足机器人在行走和奔跑过程中的扰动抑制。他们使用CMG作为全驱动双足机器人的辅助稳定装置,并将CMG集成到平衡控制框架中。这种方法可以有效地帮助机器人抵抗干扰并保持稳定。在论文2中,罗秋月等人基于具有内部状态的本质模型,开发了一种仿人机器人的自稳定行走步态。他们基于零动力学的概念,将一个基本的动力学模型扩展到仿人机器人的全动力学模型。仿人机器人通过自动调节摆动脚的步进时间和落地位置,并遵循其固有的动力学特性,实现鲁棒行走。在论文3中,Wenhan Cai等人提出了一种采用RKP和全身控制的双足机器人深蹲运动。RKP方法考虑即将到来的参考运动轨迹,并将其与基于二次规划(QP)的全身控制(WBC)相结合。与基于WBC的模型预测控制相比,该方法大大降低了计算量,对粗糙规划的适应性强,计算时间短。在paper 4中,叶林琦等人设计了一个具有腿、轮子和可重构臂的机器人系统,利用了轮子和腿的优势。该机器人系统采用腿臂重构设计,使机器人能够行走,降低了机器人的总重量,并针对复杂环境提出了基于变构型的多任务控制策略。在paper 5中,Jinmian Hou等人提出了一种新的启发式全身运动控制框架,用于重载六足机器人穿越复杂地形。他们设计了一个全身运动规划和全身扭矩控制器,并基于单刚体动力学,利用虚拟模型控制优化地面反作用力以跟踪预先规划的运动。王志诚等人的Paper 6研究了深度强化学习(deep reinforcement learning, DRL)问题,而Chaoyue Xu等人的Paper 7研究了神经网络控制问题。两者都是学习控制的重要方面。DRL方法可以帮助更有效地学习鲁棒性和多样性步态,并具有更好的地形适应性。神经网络可以改善非线性执行器的动态性能。在paper 6中,王志成等人提出了利用预训练的神经网络进行鲁棒四足动物边界的高效学习。在他们的方法中,他们设计了一个奖励函数来加强步态的对称性和周期性,以提高边界性能,并通过仿真学习反馈控制器,他们可以建立各种环境进行仿真学习。该方法已在实际四足机器人上得到应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IET Cybersystems and Robotics
IET Cybersystems and Robotics Computer Science-Information Systems
CiteScore
3.70
自引率
0.00%
发文量
31
审稿时长
34 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信