Robust adaptive guidance for autonomous asteroid landing via search-based meta-reinforcement learning

IF 3.4 2区 物理与天体物理 Q1 ENGINEERING, AEROSPACE
Zheng Chen, Shuxin Shen, Hutao Cui, Yang Tian
{"title":"Robust adaptive guidance for autonomous asteroid landing via search-based meta-reinforcement learning","authors":"Zheng Chen,&nbsp;Shuxin Shen,&nbsp;Hutao Cui,&nbsp;Yang Tian","doi":"10.1016/j.actaastro.2025.07.001","DOIUrl":null,"url":null,"abstract":"<div><div>Future asteroid missions require safe landings despite limited prior knowledge and significant uncertainties, posing a critical challenge to current autonomous guidance strategies. This paper introduces a novel robust adaptive guidance framework that integrates meta-reinforcement learning with Monte Carlo Tree Search (MCTS) to enable both rapid learning and efficient adaptation to diverse asteroids. The framework leverages a recurrent network within its meta-reinforcement learning architecture to perceive and respond to dynamic system parameters, ensuring adaptability across varied mission scenarios. The network is trained via an MCTS-based optimization algorithm, where the tree search enhances policy exploration and effectively handles the high-latency rewards of the landing task. Moreover, we introduce an enhanced MCTS by incorporating double progressive widening modifications to refine the deployed action policies. Numerical simulations demonstrate the proposed framework’s superior performance and robustness in achieving reliable landing guidance across a wide range of environmental uncertainties.</div></div>","PeriodicalId":44971,"journal":{"name":"Acta Astronautica","volume":"236 ","pages":"Pages 723-734"},"PeriodicalIF":3.4000,"publicationDate":"2025-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Acta Astronautica","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0094576525004229","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, AEROSPACE","Score":null,"Total":0}
引用次数: 0

Abstract

Future asteroid missions require safe landings despite limited prior knowledge and significant uncertainties, posing a critical challenge to current autonomous guidance strategies. This paper introduces a novel robust adaptive guidance framework that integrates meta-reinforcement learning with Monte Carlo Tree Search (MCTS) to enable both rapid learning and efficient adaptation to diverse asteroids. The framework leverages a recurrent network within its meta-reinforcement learning architecture to perceive and respond to dynamic system parameters, ensuring adaptability across varied mission scenarios. The network is trained via an MCTS-based optimization algorithm, where the tree search enhances policy exploration and effectively handles the high-latency rewards of the landing task. Moreover, we introduce an enhanced MCTS by incorporating double progressive widening modifications to refine the deployed action policies. Numerical simulations demonstrate the proposed framework’s superior performance and robustness in achieving reliable landing guidance across a wide range of environmental uncertainties.
基于搜索的元强化学习的自主小行星着陆鲁棒自适应制导
未来的小行星任务需要安全着陆,尽管有限的先验知识和重大的不确定性,对当前的自主制导策略提出了重大挑战。本文介绍了一种新的鲁棒自适应制导框架,该框架将元强化学习与蒙特卡罗树搜索(MCTS)相结合,以实现快速学习和有效适应不同的小行星。该框架利用元强化学习架构中的循环网络来感知和响应动态系统参数,确保在不同任务场景中的适应性。该网络通过基于mcts的优化算法进行训练,其中树搜索增强了策略探索,并有效地处理了着陆任务的高延迟奖励。此外,我们引入了一个增强的MCTS,通过合并双渐进式扩展修改来完善部署的操作策略。数值仿真结果表明,该框架在大范围不确定性环境下具有优异的性能和鲁棒性,能够实现可靠的着陆制导。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Acta Astronautica
Acta Astronautica 工程技术-工程:宇航
CiteScore
7.20
自引率
22.90%
发文量
599
审稿时长
53 days
期刊介绍: Acta Astronautica is sponsored by the International Academy of Astronautics. Content is based on original contributions in all fields of basic, engineering, life and social space sciences and of space technology related to: The peaceful scientific exploration of space, Its exploitation for human welfare and progress, Conception, design, development and operation of space-borne and Earth-based systems, In addition to regular issues, the journal publishes selected proceedings of the annual International Astronautical Congress (IAC), transactions of the IAA and special issues on topics of current interest, such as microgravity, space station technology, geostationary orbits, and space economics. Other subject areas include satellite technology, space transportation and communications, space energy, power and propulsion, astrodynamics, extraterrestrial intelligence and Earth observations.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信