基于多智能体强化学习的协同干扰模式调整方法

IF 5.9 2区 工程技术 Q1 ENGINEERING, MULTIDISCIPLINARY
Jieling Wang, Yanfei Liu, Chao Li, Dongdong Yang, Qingshan Yin
{"title":"基于多智能体强化学习的协同干扰模式调整方法","authors":"Jieling Wang,&nbsp;Yanfei Liu,&nbsp;Chao Li,&nbsp;Dongdong Yang,&nbsp;Qingshan Yin","doi":"10.1016/j.asej.2025.103672","DOIUrl":null,"url":null,"abstract":"<div><div>With the advancement of multifunctional netted radar systems (NRS), traditional jamming decision-making strategies struggle to adapt to the nonlinear challenges of dynamic electromagnetic countermeasures environments, particularly against multifunctional NRS. To address this, we propose a Multi-agent Joint Collaborative Jamming Adjustment Method (MJCJMA). Firstly, a non-cooperative adversarial scenario model is constructed, employing an improved snow melting algorithm (GPSAO-LSSVM) for radar threat pre-evaluation. And a threat quantification model is developed using enhanced entropy weighting (IEWM) and improved TOPSIS (ITOPSIS). Then, a multi-agent reinforcement learning algorithm is designed, integrating prioritized experience replay, entropy regularization, and reward centering to improve efficiency and stability. Furthermore, an alternating training strategy is proposed, which significantly accelerates the convergence process. Extensive simulation results validate the superiority of MJCJMA, which significantly reducing radar detection probability (96.25% vs. baseline, 47.51% vs. non-alternating training) and threat levels, thereby enabling intelligent jamming decisions in adversarial scenarios.</div></div>","PeriodicalId":48648,"journal":{"name":"Ain Shams Engineering Journal","volume":"16 11","pages":"Article 103672"},"PeriodicalIF":5.9000,"publicationDate":"2025-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A cooperative jamming mode adjustment method based on Multi-Agent reinforcement learning\",\"authors\":\"Jieling Wang,&nbsp;Yanfei Liu,&nbsp;Chao Li,&nbsp;Dongdong Yang,&nbsp;Qingshan Yin\",\"doi\":\"10.1016/j.asej.2025.103672\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>With the advancement of multifunctional netted radar systems (NRS), traditional jamming decision-making strategies struggle to adapt to the nonlinear challenges of dynamic electromagnetic countermeasures environments, particularly against multifunctional NRS. To address this, we propose a Multi-agent Joint Collaborative Jamming Adjustment Method (MJCJMA). Firstly, a non-cooperative adversarial scenario model is constructed, employing an improved snow melting algorithm (GPSAO-LSSVM) for radar threat pre-evaluation. And a threat quantification model is developed using enhanced entropy weighting (IEWM) and improved TOPSIS (ITOPSIS). Then, a multi-agent reinforcement learning algorithm is designed, integrating prioritized experience replay, entropy regularization, and reward centering to improve efficiency and stability. Furthermore, an alternating training strategy is proposed, which significantly accelerates the convergence process. Extensive simulation results validate the superiority of MJCJMA, which significantly reducing radar detection probability (96.25% vs. baseline, 47.51% vs. non-alternating training) and threat levels, thereby enabling intelligent jamming decisions in adversarial scenarios.</div></div>\",\"PeriodicalId\":48648,\"journal\":{\"name\":\"Ain Shams Engineering Journal\",\"volume\":\"16 11\",\"pages\":\"Article 103672\"},\"PeriodicalIF\":5.9000,\"publicationDate\":\"2025-08-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ain Shams Engineering Journal\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2090447925004137\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ain Shams Engineering Journal","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2090447925004137","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

随着多功能组网雷达系统(NRS)的发展,传统的干扰决策策略难以适应动态电磁对抗环境的非线性挑战,尤其是针对多功能组网雷达的干扰。为了解决这个问题,我们提出了一种多智能体联合协同干扰调节方法(MJCJMA)。首先,构建非合作对抗场景模型,采用改进的积雪融雪算法(GPSAO-LSSVM)进行雷达威胁预评估;利用增强熵权法(IEWM)和改进TOPSIS法(ITOPSIS)建立了威胁量化模型。然后,设计了一种多智能体强化学习算法,将优先经验重播、熵正则化和奖励定心相结合,提高了学习效率和稳定性。在此基础上,提出了交替训练策略,显著加快了收敛速度。大量的仿真结果验证了MJCJMA的优越性,它显著降低了雷达探测概率(与基线相比为96.25%,与非交替训练相比为47.51%)和威胁水平,从而实现了对抗场景下的智能干扰决策。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A cooperative jamming mode adjustment method based on Multi-Agent reinforcement learning
With the advancement of multifunctional netted radar systems (NRS), traditional jamming decision-making strategies struggle to adapt to the nonlinear challenges of dynamic electromagnetic countermeasures environments, particularly against multifunctional NRS. To address this, we propose a Multi-agent Joint Collaborative Jamming Adjustment Method (MJCJMA). Firstly, a non-cooperative adversarial scenario model is constructed, employing an improved snow melting algorithm (GPSAO-LSSVM) for radar threat pre-evaluation. And a threat quantification model is developed using enhanced entropy weighting (IEWM) and improved TOPSIS (ITOPSIS). Then, a multi-agent reinforcement learning algorithm is designed, integrating prioritized experience replay, entropy regularization, and reward centering to improve efficiency and stability. Furthermore, an alternating training strategy is proposed, which significantly accelerates the convergence process. Extensive simulation results validate the superiority of MJCJMA, which significantly reducing radar detection probability (96.25% vs. baseline, 47.51% vs. non-alternating training) and threat levels, thereby enabling intelligent jamming decisions in adversarial scenarios.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Ain Shams Engineering Journal
Ain Shams Engineering Journal Engineering-General Engineering
CiteScore
10.80
自引率
13.30%
发文量
441
审稿时长
49 weeks
期刊介绍: in Shams Engineering Journal is an international journal devoted to publication of peer reviewed original high-quality research papers and review papers in both traditional topics and those of emerging science and technology. Areas of both theoretical and fundamental interest as well as those concerning industrial applications, emerging instrumental techniques and those which have some practical application to an aspect of human endeavor, such as the preservation of the environment, health, waste disposal are welcome. The overall focus is on original and rigorous scientific research results which have generic significance. Ain Shams Engineering Journal focuses upon aspects of mechanical engineering, electrical engineering, civil engineering, chemical engineering, petroleum engineering, environmental engineering, architectural and urban planning engineering. Papers in which knowledge from other disciplines is integrated with engineering are especially welcome like nanotechnology, material sciences, and computational methods as well as applied basic sciences: engineering mathematics, physics and chemistry.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信