基于目标感知意图预测和强化学习的对抗场景中以人为中心的UAV-MAV团队

IF 1.1 4区 工程技术 Q4 ENGINEERING, ELECTRICAL & ELECTRONIC
Wei Hao, Huaping Liu, Jia Liu, Wenjie Li, Lijun Chen
{"title":"基于目标感知意图预测和强化学习的对抗场景中以人为中心的UAV-MAV团队","authors":"Wei Hao,&nbsp;Huaping Liu,&nbsp;Jia Liu,&nbsp;Wenjie Li,&nbsp;Lijun Chen","doi":"10.1049/sil2/7719848","DOIUrl":null,"url":null,"abstract":"<div>\n <p>Tacit understanding refers to the ability of team members to work together seamlessly and intuitively without explicitly communicating in detail. This ability is crucial for effective teamwork in complex situations that involve both manned and unmanned aerial vehicles (UAVs). Existing collaborative tasks between manned and unmanned aircraft focus mainly on optimizing communication and the UAVs’ flight paths but neglect the benefits of tacit and intelligent operational cooperation with pilots. To address this limitation, we propose a tacit collaborative attack method that utilizes the UAVs’ capacity for tacit understanding to infer human intent and select the appropriate targets for collaborative attack missions. A learning framework incorporating intention prediction and reinforcement learning paradigms is developed to teach the UAV to generate corresponding collaborative attack actions. Finally, we present results from extensive simulation experiments in a homemade game environment to demonstrate the efficiency and scalability of our method within the proposed framework. The video can be found at https://www.youtube.com/watch?v=CjXhkD7ko14.</p>\n </div>","PeriodicalId":56301,"journal":{"name":"IET Signal Processing","volume":"2024 1","pages":""},"PeriodicalIF":1.1000,"publicationDate":"2024-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/sil2/7719848","citationCount":"0","resultStr":"{\"title\":\"Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning\",\"authors\":\"Wei Hao,&nbsp;Huaping Liu,&nbsp;Jia Liu,&nbsp;Wenjie Li,&nbsp;Lijun Chen\",\"doi\":\"10.1049/sil2/7719848\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n <p>Tacit understanding refers to the ability of team members to work together seamlessly and intuitively without explicitly communicating in detail. This ability is crucial for effective teamwork in complex situations that involve both manned and unmanned aerial vehicles (UAVs). Existing collaborative tasks between manned and unmanned aircraft focus mainly on optimizing communication and the UAVs’ flight paths but neglect the benefits of tacit and intelligent operational cooperation with pilots. To address this limitation, we propose a tacit collaborative attack method that utilizes the UAVs’ capacity for tacit understanding to infer human intent and select the appropriate targets for collaborative attack missions. A learning framework incorporating intention prediction and reinforcement learning paradigms is developed to teach the UAV to generate corresponding collaborative attack actions. Finally, we present results from extensive simulation experiments in a homemade game environment to demonstrate the efficiency and scalability of our method within the proposed framework. The video can be found at https://www.youtube.com/watch?v=CjXhkD7ko14.</p>\\n </div>\",\"PeriodicalId\":56301,\"journal\":{\"name\":\"IET Signal Processing\",\"volume\":\"2024 1\",\"pages\":\"\"},\"PeriodicalIF\":1.1000,\"publicationDate\":\"2024-12-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1049/sil2/7719848\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/sil2/7719848\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/sil2/7719848","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

默契是指团队成员在没有明确沟通细节的情况下,凭借直觉无缝协作的能力。在涉及有人驾驶飞行器和无人驾驶飞行器(UAV)的复杂情况下,这种能力对于有效的团队合作至关重要。现有的有人驾驶飞机和无人驾驶飞机之间的协作任务主要集中在优化通信和无人驾驶飞机的飞行路径上,却忽视了与飞行员之间默契的智能操作合作所带来的益处。针对这一局限,我们提出了一种默契协同攻击方法,利用无人机的默契理解能力来推断人类意图,并为协同攻击任务选择合适的目标。我们还开发了一个包含意图预测和强化学习范例的学习框架,用于指导无人机生成相应的协同攻击行动。最后,我们介绍了在自制游戏环境中进行的大量模拟实验的结果,以证明我们的方法在拟议框架内的效率和可扩展性。视频请访问 https://www.youtube.com/watch?v=CjXhkD7ko14。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning

Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning

Tacit understanding refers to the ability of team members to work together seamlessly and intuitively without explicitly communicating in detail. This ability is crucial for effective teamwork in complex situations that involve both manned and unmanned aerial vehicles (UAVs). Existing collaborative tasks between manned and unmanned aircraft focus mainly on optimizing communication and the UAVs’ flight paths but neglect the benefits of tacit and intelligent operational cooperation with pilots. To address this limitation, we propose a tacit collaborative attack method that utilizes the UAVs’ capacity for tacit understanding to infer human intent and select the appropriate targets for collaborative attack missions. A learning framework incorporating intention prediction and reinforcement learning paradigms is developed to teach the UAV to generate corresponding collaborative attack actions. Finally, we present results from extensive simulation experiments in a homemade game environment to demonstrate the efficiency and scalability of our method within the proposed framework. The video can be found at https://www.youtube.com/watch?v=CjXhkD7ko14.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IET Signal Processing
IET Signal Processing 工程技术-工程:电子与电气
CiteScore
3.80
自引率
5.90%
发文量
83
审稿时长
9.5 months
期刊介绍: IET Signal Processing publishes research on a diverse range of signal processing and machine learning topics, covering a variety of applications, disciplines, modalities, and techniques in detection, estimation, inference, and classification problems. The research published includes advances in algorithm design for the analysis of single and high-multi-dimensional data, sparsity, linear and non-linear systems, recursive and non-recursive digital filters and multi-rate filter banks, as well a range of topics that span from sensor array processing, deep convolutional neural network based approaches to the application of chaos theory, and far more. Topics covered by scope include, but are not limited to: advances in single and multi-dimensional filter design and implementation linear and nonlinear, fixed and adaptive digital filters and multirate filter banks statistical signal processing techniques and analysis classical, parametric and higher order spectral analysis signal transformation and compression techniques, including time-frequency analysis system modelling and adaptive identification techniques machine learning based approaches to signal processing Bayesian methods for signal processing, including Monte-Carlo Markov-chain and particle filtering techniques theory and application of blind and semi-blind signal separation techniques signal processing techniques for analysis, enhancement, coding, synthesis and recognition of speech signals direction-finding and beamforming techniques for audio and electromagnetic signals analysis techniques for biomedical signals baseband signal processing techniques for transmission and reception of communication signals signal processing techniques for data hiding and audio watermarking sparse signal processing and compressive sensing Special Issue Call for Papers: Intelligent Deep Fuzzy Model for Signal Processing - https://digital-library.theiet.org/files/IET_SPR_CFP_IDFMSP.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信