四足机器人在不同任务指令下的自适应观察状态选择

IF 4.4 3区 计算机科学 Q1 ENGINEERING, MULTIDISCIPLINARY
Tianyu Zhang, Jieliang Zhao, Qun Niu, Xuemei Chen
{"title":"四足机器人在不同任务指令下的自适应观察状态选择","authors":"Tianyu Zhang,&nbsp;Jieliang Zhao,&nbsp;Qun Niu,&nbsp;Xuemei Chen","doi":"10.1007/s42235-026-00954-2","DOIUrl":null,"url":null,"abstract":"<div><p>Reinforcement-learning-based controllers for lightweight robot control in structured, rather than complex, scenarios have received comparatively little attention. Lightweight control aims to achieve performance comparable to full observation-based control by relying on a minimal set of key observation factors. This study finds that different key observation factors become important under different commands. Therefore, the effectiveness of such methods still requires further enhancement. To better understand the influence of observation states on action generation and enhance lightweight control performance, this paper proposes a method based on an improved Integrated Gradients algorithm to quantify the importance of observation variables in quadruped robot control. By combining sampling and fitting techniques, the variation pattern of observation importance weights is derived with respect to different velocity commands, and the optimal observation subsets are identified under specific command conditions. To enable real-time switching of observation subsets during inference based on command input, a multi-encoder training framework is introduced. This framework encodes and learns multiple observation subsets using a shared replay buffer and a Multi-stage Encoder Switching Architecture. Simulation results demonstrate that different observation subsets are optimal for different command ranges. The proposed command-driven observation selection strategy improves the overall performance score by 5.33% compared with fixed Determined State Observation configurations. Real-world experiments validate similar trends, highlighting the potential of this approach for lightweight robot control and the exploration of biologically inspired locomotion mechanisms.</p></div>","PeriodicalId":614,"journal":{"name":"Journal of Bionic Engineering","volume":"23 5","pages":"2985 - 3000"},"PeriodicalIF":4.4000,"publicationDate":"2026-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adaptive Observation State Selection for a Quadruped Robot Under Varying Task Commands\",\"authors\":\"Tianyu Zhang,&nbsp;Jieliang Zhao,&nbsp;Qun Niu,&nbsp;Xuemei Chen\",\"doi\":\"10.1007/s42235-026-00954-2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Reinforcement-learning-based controllers for lightweight robot control in structured, rather than complex, scenarios have received comparatively little attention. Lightweight control aims to achieve performance comparable to full observation-based control by relying on a minimal set of key observation factors. This study finds that different key observation factors become important under different commands. Therefore, the effectiveness of such methods still requires further enhancement. To better understand the influence of observation states on action generation and enhance lightweight control performance, this paper proposes a method based on an improved Integrated Gradients algorithm to quantify the importance of observation variables in quadruped robot control. By combining sampling and fitting techniques, the variation pattern of observation importance weights is derived with respect to different velocity commands, and the optimal observation subsets are identified under specific command conditions. To enable real-time switching of observation subsets during inference based on command input, a multi-encoder training framework is introduced. This framework encodes and learns multiple observation subsets using a shared replay buffer and a Multi-stage Encoder Switching Architecture. Simulation results demonstrate that different observation subsets are optimal for different command ranges. The proposed command-driven observation selection strategy improves the overall performance score by 5.33% compared with fixed Determined State Observation configurations. Real-world experiments validate similar trends, highlighting the potential of this approach for lightweight robot control and the exploration of biologically inspired locomotion mechanisms.</p></div>\",\"PeriodicalId\":614,\"journal\":{\"name\":\"Journal of Bionic Engineering\",\"volume\":\"23 5\",\"pages\":\"2985 - 3000\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2026-07-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Bionic Engineering\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s42235-026-00954-2\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Bionic Engineering","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s42235-026-00954-2","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

基于强化学习的轻型机器人控制器在结构化而非复杂场景下的控制得到的关注相对较少。轻量级控制旨在通过依赖最小的关键观察因素集来实现与完全基于观察的控制相当的性能。研究发现,在不同的指挥下,不同的关键观测因素变得重要。因此,这些方法的有效性还有待进一步提高。为了更好地理解观察状态对动作生成的影响,提高轻量化控制性能,本文提出了一种基于改进的集成梯度算法量化四足机器人控制中观察变量重要性的方法。通过采样与拟合相结合的方法,推导了观测重要度权重在不同速度指令下的变化规律,并在特定指令条件下识别出最优观测子集。为了在基于命令输入的推理过程中实现观测子集的实时切换,引入了一种多编码器训练框架。该框架使用共享重放缓冲区和多阶段编码器交换架构对多个观察子集进行编码和学习。仿真结果表明,对于不同的命令范围,不同的观测子集是最优的。所提出的命令驱动的观测选择策略与固定的确定状态观测配置相比,总体性能得分提高了5.33%。现实世界的实验验证了类似的趋势,突出了这种方法在轻型机器人控制和探索生物启发运动机制方面的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Adaptive Observation State Selection for a Quadruped Robot Under Varying Task Commands

Reinforcement-learning-based controllers for lightweight robot control in structured, rather than complex, scenarios have received comparatively little attention. Lightweight control aims to achieve performance comparable to full observation-based control by relying on a minimal set of key observation factors. This study finds that different key observation factors become important under different commands. Therefore, the effectiveness of such methods still requires further enhancement. To better understand the influence of observation states on action generation and enhance lightweight control performance, this paper proposes a method based on an improved Integrated Gradients algorithm to quantify the importance of observation variables in quadruped robot control. By combining sampling and fitting techniques, the variation pattern of observation importance weights is derived with respect to different velocity commands, and the optimal observation subsets are identified under specific command conditions. To enable real-time switching of observation subsets during inference based on command input, a multi-encoder training framework is introduced. This framework encodes and learns multiple observation subsets using a shared replay buffer and a Multi-stage Encoder Switching Architecture. Simulation results demonstrate that different observation subsets are optimal for different command ranges. The proposed command-driven observation selection strategy improves the overall performance score by 5.33% compared with fixed Determined State Observation configurations. Real-world experiments validate similar trends, highlighting the potential of this approach for lightweight robot control and the exploration of biologically inspired locomotion mechanisms.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Bionic Engineering
Journal of Bionic Engineering 工程技术-材料科学:生物材料
CiteScore
7.10
自引率
10.00%
发文量
162
审稿时长
10.0 months
期刊介绍: The Journal of Bionic Engineering (JBE) is a peer-reviewed journal that publishes original research papers and reviews that apply the knowledge learned from nature and biological systems to solve concrete engineering problems. The topics that JBE covers include but are not limited to: Mechanisms, kinematical mechanics and control of animal locomotion, development of mobile robots with walking (running and crawling), swimming or flying abilities inspired by animal locomotion. Structures, morphologies, composition and physical properties of natural and biomaterials; fabrication of new materials mimicking the properties and functions of natural and biomaterials. Biomedical materials, artificial organs and tissue engineering for medical applications; rehabilitation equipment and devices. Development of bioinspired computation methods and artificial intelligence for engineering applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书