Federated Edge Learning With Differential Privacy: An Active Reconfigurable Intelligent Surface Approach

IF 8.9 1区 计算机科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Yuanming Shi;Yuhan Yang;Youlong Wu
{"title":"Federated Edge Learning With Differential Privacy: An Active Reconfigurable Intelligent Surface Approach","authors":"Yuanming Shi;Yuhan Yang;Youlong Wu","doi":"10.1109/TWC.2024.3453392","DOIUrl":null,"url":null,"abstract":"Federated edge learning (FL) has become an unprecedented machine learning paradigm that enables distributed training across multiple edge devices without sharing their private data. Nevertheless, recent privacy eavesdropping attacks have raised severe privacy concerns, which make FL untrustworsthy and thus hinder the wide deployment of FL in emerging high-stake applications, such as vehicular networks and healthcare industry. Fortunately, differential privacy (DP) provides a flexible approach by introducing additional randomness to the released model updates so that the eavesdroppers cannot divulge any private information. However, the injected perturbation ensures privacy at the expense of learning accuracy and communication cost, yielding an accuracy-privacy-communication dilemma. In this article, we propose an active reconfigurable intelligent surface (RIS) approach to tackle the dilemma in differentially private FL, which is achieved by exploiting the reconfigurability of active RIS to address the heterogeneous wireless links and privacy concerns, as well as the waveform superposition property with over-the-air computation (AirComp) for low-latency model aggregation. We comprehensively analyze the convergence behavior and systematic privacy guarantee of the active RIS-enabled differentially private FL system, followed by proposing a two-step online power adaptation scheme to minimize the learning optimality gap while satisfying the systematic privacy and power constraints by jointly designing the transmit scalar and artificial noise at the edge devices and the reflection beamforming pattern at the active RIS. Simulation results validate our theoretical achievements and demonstrate the advancements of active RIS in addressing the accuracy-privacy-communication dilemma in differentially private FL.","PeriodicalId":13431,"journal":{"name":"IEEE Transactions on Wireless Communications","volume":"23 11","pages":"17368-17383"},"PeriodicalIF":8.9000,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Wireless Communications","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10678839/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Federated edge learning (FL) has become an unprecedented machine learning paradigm that enables distributed training across multiple edge devices without sharing their private data. Nevertheless, recent privacy eavesdropping attacks have raised severe privacy concerns, which make FL untrustworsthy and thus hinder the wide deployment of FL in emerging high-stake applications, such as vehicular networks and healthcare industry. Fortunately, differential privacy (DP) provides a flexible approach by introducing additional randomness to the released model updates so that the eavesdroppers cannot divulge any private information. However, the injected perturbation ensures privacy at the expense of learning accuracy and communication cost, yielding an accuracy-privacy-communication dilemma. In this article, we propose an active reconfigurable intelligent surface (RIS) approach to tackle the dilemma in differentially private FL, which is achieved by exploiting the reconfigurability of active RIS to address the heterogeneous wireless links and privacy concerns, as well as the waveform superposition property with over-the-air computation (AirComp) for low-latency model aggregation. We comprehensively analyze the convergence behavior and systematic privacy guarantee of the active RIS-enabled differentially private FL system, followed by proposing a two-step online power adaptation scheme to minimize the learning optimality gap while satisfying the systematic privacy and power constraints by jointly designing the transmit scalar and artificial noise at the edge devices and the reflection beamforming pattern at the active RIS. Simulation results validate our theoretical achievements and demonstrate the advancements of active RIS in addressing the accuracy-privacy-communication dilemma in differentially private FL.
具有差异隐私的边缘联合学习:主动可重构智能表面方法
联合边缘学习(FL)已成为一种前所未有的机器学习模式,它能在不共享私人数据的情况下,在多个边缘设备上进行分布式训练。然而,最近的隐私窃听攻击引发了严重的隐私问题,这使得边缘学习变得不可信,从而阻碍了边缘学习在新兴的高风险应用(如车载网络和医疗保健行业)中的广泛部署。幸运的是,差分隐私(DP)提供了一种灵活的方法,即在发布的模型更新中引入额外的随机性,从而使窃听者无法泄露任何隐私信息。然而,注入的扰动在确保隐私的同时,也牺牲了学习的准确性和通信成本,从而产生了准确性-隐私-通信的两难问题。本文提出了一种主动可重构智能表面(RIS)方法,利用主动 RIS 的可重构性来解决异构无线链路和隐私问题,并利用波形叠加特性和空中计算(AirComp)来实现低延迟模型聚合,从而解决不同隐私 FL 中的两难问题。我们全面分析了有源 RIS 支持的差异化隐私 FL 系统的收敛行为和系统隐私保证,随后提出了一种两步在线功率适应方案,通过联合设计边缘设备的发射标量和人工噪声以及有源 RIS 的反射波束成形模式,在满足系统隐私和功率约束的同时最小化学习优化差距。仿真结果验证了我们的理论成果,并证明了有源 RIS 在解决不同隐私 FL 中的精度-隐私-通信两难问题方面所取得的进步。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
18.60
自引率
10.60%
发文量
708
审稿时长
5.6 months
期刊介绍: The IEEE Transactions on Wireless Communications is a prestigious publication that showcases cutting-edge advancements in wireless communications. It welcomes both theoretical and practical contributions in various areas. The scope of the Transactions encompasses a wide range of topics, including modulation and coding, detection and estimation, propagation and channel characterization, and diversity techniques. The journal also emphasizes the physical and link layer communication aspects of network architectures and protocols. The journal is open to papers on specific topics or non-traditional topics related to specific application areas. This includes simulation tools and methodologies, orthogonal frequency division multiplexing, MIMO systems, and wireless over optical technologies. Overall, the IEEE Transactions on Wireless Communications serves as a platform for high-quality manuscripts that push the boundaries of wireless communications and contribute to advancements in the field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信