Collaborative strategy for hybrid actions of radar modes and maneuver decisions under observation errors

IF 7.5 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Xingyu Wang , Zhen Yang , Jichuan Huang , Bao Zhang , Yuhe Zhang , Deyun Zhou
{"title":"Collaborative strategy for hybrid actions of radar modes and maneuver decisions under observation errors","authors":"Xingyu Wang ,&nbsp;Zhen Yang ,&nbsp;Jichuan Huang ,&nbsp;Bao Zhang ,&nbsp;Yuhe Zhang ,&nbsp;Deyun Zhou","doi":"10.1016/j.engappai.2025.111774","DOIUrl":null,"url":null,"abstract":"<div><div>The rapid advancement of airborne avionics has driven modern air combat to rely heavily on information-centric operations, with radar serving as a primary tool for information acquisition and playing a critical role in air combat. However, existing research on air combat strategies often overlooks the impact of different radar operating modes on maneuvering strategies, as well as the challenges posed by learning strategies under observational disturbances. To address these gaps, this study investigates the problem of hybrid actions decision-making for radar modes and maneuver decisions in the presence of observational errors. Specifically, the characteristics of various radar operating modes are analyzed and modeled, followed by an exploration of the convergence process of reinforcement learning strategies under observational disturbances. To mitigate the instability and volatility in strategy learning caused by observation errors, Entropy-Decoupling-Noisy-net Proximal Policy Optimization-Advanced (EDN-PPOA) algorithm is proposed, which significantly enhances the robustness and exploratory capability of the model. Simulation results demonstrate that the proposed algorithm effectively achieves coordinated tactical integration of radar modes and maneuvers in complex hybrid action spaces, producing flexible tactical strategies that outperform expert-designed heuristics. Furthermore, compared to the existing algorithms, the proposed method exhibits superior stability and robustness in noisy observational environments, providing a reliable technical foundation for intelligent decision-making in complex adversarial scenarios.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"160 ","pages":"Article 111774"},"PeriodicalIF":7.5000,"publicationDate":"2025-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625017762","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

The rapid advancement of airborne avionics has driven modern air combat to rely heavily on information-centric operations, with radar serving as a primary tool for information acquisition and playing a critical role in air combat. However, existing research on air combat strategies often overlooks the impact of different radar operating modes on maneuvering strategies, as well as the challenges posed by learning strategies under observational disturbances. To address these gaps, this study investigates the problem of hybrid actions decision-making for radar modes and maneuver decisions in the presence of observational errors. Specifically, the characteristics of various radar operating modes are analyzed and modeled, followed by an exploration of the convergence process of reinforcement learning strategies under observational disturbances. To mitigate the instability and volatility in strategy learning caused by observation errors, Entropy-Decoupling-Noisy-net Proximal Policy Optimization-Advanced (EDN-PPOA) algorithm is proposed, which significantly enhances the robustness and exploratory capability of the model. Simulation results demonstrate that the proposed algorithm effectively achieves coordinated tactical integration of radar modes and maneuvers in complex hybrid action spaces, producing flexible tactical strategies that outperform expert-designed heuristics. Furthermore, compared to the existing algorithms, the proposed method exhibits superior stability and robustness in noisy observational environments, providing a reliable technical foundation for intelligent decision-making in complex adversarial scenarios.
观测误差下雷达模式与机动决策混合行动的协同策略
机载航空电子设备的快速发展使现代空战严重依赖于以信息为中心的作战,雷达作为信息获取的主要工具,在空战中起着至关重要的作用。然而,现有的空战策略研究往往忽略了不同雷达工作模式对机动策略的影响,以及在观测干扰下学习策略所带来的挑战。为了解决这些问题,本研究探讨了存在观测误差的雷达模式和机动决策的混合行动决策问题。具体而言,分析和建模了各种雷达工作模式的特征,然后探索了观测干扰下强化学习策略的收敛过程。为了减轻由于观测误差导致的策略学习中的不稳定性和波动性,提出了熵解耦-噪声-网络近端策略优化-高级(EDN-PPOA)算法,显著提高了模型的鲁棒性和探索性。仿真结果表明,该算法有效地实现了复杂混合行动空间中雷达模式与机动的协调战术集成,产生了优于专家设计启发式的灵活战术策略。此外,与现有算法相比,该方法在噪声观测环境下具有更好的稳定性和鲁棒性,为复杂对抗场景下的智能决策提供了可靠的技术基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence 工程技术-工程:电子与电气
CiteScore
9.60
自引率
10.00%
发文量
505
审稿时长
68 days
期刊介绍: Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信