Xingyu Wang , Zhen Yang , Jichuan Huang , Bao Zhang , Yuhe Zhang , Deyun Zhou
{"title":"Collaborative strategy for hybrid actions of radar modes and maneuver decisions under observation errors","authors":"Xingyu Wang , Zhen Yang , Jichuan Huang , Bao Zhang , Yuhe Zhang , Deyun Zhou","doi":"10.1016/j.engappai.2025.111774","DOIUrl":null,"url":null,"abstract":"<div><div>The rapid advancement of airborne avionics has driven modern air combat to rely heavily on information-centric operations, with radar serving as a primary tool for information acquisition and playing a critical role in air combat. However, existing research on air combat strategies often overlooks the impact of different radar operating modes on maneuvering strategies, as well as the challenges posed by learning strategies under observational disturbances. To address these gaps, this study investigates the problem of hybrid actions decision-making for radar modes and maneuver decisions in the presence of observational errors. Specifically, the characteristics of various radar operating modes are analyzed and modeled, followed by an exploration of the convergence process of reinforcement learning strategies under observational disturbances. To mitigate the instability and volatility in strategy learning caused by observation errors, Entropy-Decoupling-Noisy-net Proximal Policy Optimization-Advanced (EDN-PPOA) algorithm is proposed, which significantly enhances the robustness and exploratory capability of the model. Simulation results demonstrate that the proposed algorithm effectively achieves coordinated tactical integration of radar modes and maneuvers in complex hybrid action spaces, producing flexible tactical strategies that outperform expert-designed heuristics. Furthermore, compared to the existing algorithms, the proposed method exhibits superior stability and robustness in noisy observational environments, providing a reliable technical foundation for intelligent decision-making in complex adversarial scenarios.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"160 ","pages":"Article 111774"},"PeriodicalIF":7.5000,"publicationDate":"2025-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625017762","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
The rapid advancement of airborne avionics has driven modern air combat to rely heavily on information-centric operations, with radar serving as a primary tool for information acquisition and playing a critical role in air combat. However, existing research on air combat strategies often overlooks the impact of different radar operating modes on maneuvering strategies, as well as the challenges posed by learning strategies under observational disturbances. To address these gaps, this study investigates the problem of hybrid actions decision-making for radar modes and maneuver decisions in the presence of observational errors. Specifically, the characteristics of various radar operating modes are analyzed and modeled, followed by an exploration of the convergence process of reinforcement learning strategies under observational disturbances. To mitigate the instability and volatility in strategy learning caused by observation errors, Entropy-Decoupling-Noisy-net Proximal Policy Optimization-Advanced (EDN-PPOA) algorithm is proposed, which significantly enhances the robustness and exploratory capability of the model. Simulation results demonstrate that the proposed algorithm effectively achieves coordinated tactical integration of radar modes and maneuvers in complex hybrid action spaces, producing flexible tactical strategies that outperform expert-designed heuristics. Furthermore, compared to the existing algorithms, the proposed method exhibits superior stability and robustness in noisy observational environments, providing a reliable technical foundation for intelligent decision-making in complex adversarial scenarios.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.