Perturbation-Controlled Deep Q-Learning With Human-Teaming for Enhancing Adversarial Robustness

IF 2 Q2 AUTOMATION & CONTROL SYSTEMS
Sadredin Hokmi;Pegah Moushaee;Mohammad Haeri
{"title":"Perturbation-Controlled Deep Q-Learning With Human-Teaming for Enhancing Adversarial Robustness","authors":"Sadredin Hokmi;Pegah Moushaee;Mohammad Haeri","doi":"10.1109/LCSYS.2025.3594257","DOIUrl":null,"url":null,"abstract":"In this letter, an integrated framework of perturbation-controlled deep Q-network with human- teaming is proposed to effectively mitigate the impact of adversarial disturbances, specifically false data injection and denial-of-service attacks. Through a convergence and error-compensation mechanism, the proposed integration substantially reduces the effects of such errors. The incorporation of human intervention introduces a favorable trade-off between convergence speed and robustness, which is particularly critical in safety-sensitive applications where robustness must take precedence over fast convergence through adaptive quantized perturbation injection integrating with human-teaming. Consequently, the algorithm enables efficient and reliable recovery while maintaining satisfactory performance levels. Simulation results demonstrate that within adversarial intervals, the proposed method exhibits superior capability in mitigating and compensating for injected errors compared to conventional deep Q-network-based approach.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":"9 ","pages":"2303-2308"},"PeriodicalIF":2.0000,"publicationDate":"2025-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Control Systems Letters","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/11104842/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

In this letter, an integrated framework of perturbation-controlled deep Q-network with human- teaming is proposed to effectively mitigate the impact of adversarial disturbances, specifically false data injection and denial-of-service attacks. Through a convergence and error-compensation mechanism, the proposed integration substantially reduces the effects of such errors. The incorporation of human intervention introduces a favorable trade-off between convergence speed and robustness, which is particularly critical in safety-sensitive applications where robustness must take precedence over fast convergence through adaptive quantized perturbation injection integrating with human-teaming. Consequently, the algorithm enables efficient and reliable recovery while maintaining satisfactory performance levels. Simulation results demonstrate that within adversarial intervals, the proposed method exhibits superior capability in mitigating and compensating for injected errors compared to conventional deep Q-network-based approach.
基于人类团队的扰动控制深度q学习增强对抗鲁棒性
在这封信中,提出了一个具有人类团队的扰动控制深度q网络的集成框架,以有效减轻对抗性干扰的影响,特别是虚假数据注入和拒绝服务攻击。通过收敛和误差补偿机制,所提出的集成大大降低了这些误差的影响。人为干预的结合在收敛速度和鲁棒性之间引入了有利的权衡,这在安全性敏感的应用中尤为重要,因为鲁棒性必须优先于通过自适应量化扰动注入与人类团队相结合的快速收敛。因此,该算法可以在保持令人满意的性能水平的同时实现高效可靠的恢复。仿真结果表明,在对抗区间内,与传统的基于深度q网络的方法相比,该方法具有更好的抑制和补偿注入误差的能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Control Systems Letters
IEEE Control Systems Letters Mathematics-Control and Optimization
CiteScore
4.40
自引率
13.30%
发文量
471
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信