FedDBG:针对中毒攻击的联邦学习中保护隐私的动态基准梯度

Mengfan Xu
{"title":"FedDBG:针对中毒攻击的联邦学习中保护隐私的动态基准梯度","authors":"Mengfan Xu","doi":"10.1109/NaNA56854.2022.00089","DOIUrl":null,"url":null,"abstract":"The federated learning's (FL) ability to protect local data privacy while cooperatively training powerful global models has received extensive attention. Although some researchers have carried out researches on gradient privacy disclosure under poisoning attacks, the existing works still ignore the unreliability of initial data, which makes it difficult to obtain the benign initial reference gradient, resulting in a significant decline in the accuracy of the final global model. To solve this problem, we propose a privacy-preserving gradient framework in FL based on homomorphic encryption. The framework can ensure that malicious initial users and subsequent users cannot interfere with the accuracy of the global model by uploading the poisoning gradients. In this process, key parameters such as gradients of local users won't be leaked. We then design a dynamic reference gradient aggregation algorithm to mitigate the poisoning attack in FL, dynamically dividing the sub-gradients of each round of local uploads by clustering the gradients of different local uploads. Furthermore, the malicious and benign gradients are further separated and the optimal global model is obtained by iterative updating. We proved the security of the scheme theoretically, and verified the effectiveness of the scheme through experiments. The accuracy of the proposed scheme is at least 80% higher than that of the scheme without anti-poisoning measures.","PeriodicalId":113743,"journal":{"name":"2022 International Conference on Networking and Network Applications (NaNA)","volume":"729 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"FedDBG: Privacy-Preserving Dynamic Benchmark Gradient in Federated Learning Against Poisoning Attacks\",\"authors\":\"Mengfan Xu\",\"doi\":\"10.1109/NaNA56854.2022.00089\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The federated learning's (FL) ability to protect local data privacy while cooperatively training powerful global models has received extensive attention. Although some researchers have carried out researches on gradient privacy disclosure under poisoning attacks, the existing works still ignore the unreliability of initial data, which makes it difficult to obtain the benign initial reference gradient, resulting in a significant decline in the accuracy of the final global model. To solve this problem, we propose a privacy-preserving gradient framework in FL based on homomorphic encryption. The framework can ensure that malicious initial users and subsequent users cannot interfere with the accuracy of the global model by uploading the poisoning gradients. In this process, key parameters such as gradients of local users won't be leaked. We then design a dynamic reference gradient aggregation algorithm to mitigate the poisoning attack in FL, dynamically dividing the sub-gradients of each round of local uploads by clustering the gradients of different local uploads. Furthermore, the malicious and benign gradients are further separated and the optimal global model is obtained by iterative updating. We proved the security of the scheme theoretically, and verified the effectiveness of the scheme through experiments. The accuracy of the proposed scheme is at least 80% higher than that of the scheme without anti-poisoning measures.\",\"PeriodicalId\":113743,\"journal\":{\"name\":\"2022 International Conference on Networking and Network Applications (NaNA)\",\"volume\":\"729 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Networking and Network Applications (NaNA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/NaNA56854.2022.00089\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Networking and Network Applications (NaNA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NaNA56854.2022.00089","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

联邦学习(FL)在协同训练强大的全局模型的同时保护本地数据隐私的能力受到了广泛关注。虽然有研究人员对投毒攻击下的梯度隐私披露进行了研究,但现有的工作仍然忽略了初始数据的不可靠性,使得难以获得良性的初始参考梯度,导致最终全局模型的精度明显下降。为了解决这一问题,我们提出了一种基于同态加密的FL中的隐私保护梯度框架。该框架可以通过上传中毒梯度来保证恶意初始用户和后续用户不会干扰全局模型的准确性。在此过程中,不会泄露本地用户的梯度等关键参数。然后,我们设计了一种动态参考梯度聚合算法,通过聚类不同本地上传的梯度来动态划分每轮本地上传的子梯度,以减轻FL中的中毒攻击。进一步分离了恶意梯度和良性梯度,并通过迭代更新得到了最优的全局模型。从理论上证明了方案的安全性,并通过实验验证了方案的有效性。与未采取防中毒措施的方案相比,所提方案的准确率至少提高80%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
FedDBG: Privacy-Preserving Dynamic Benchmark Gradient in Federated Learning Against Poisoning Attacks
The federated learning's (FL) ability to protect local data privacy while cooperatively training powerful global models has received extensive attention. Although some researchers have carried out researches on gradient privacy disclosure under poisoning attacks, the existing works still ignore the unreliability of initial data, which makes it difficult to obtain the benign initial reference gradient, resulting in a significant decline in the accuracy of the final global model. To solve this problem, we propose a privacy-preserving gradient framework in FL based on homomorphic encryption. The framework can ensure that malicious initial users and subsequent users cannot interfere with the accuracy of the global model by uploading the poisoning gradients. In this process, key parameters such as gradients of local users won't be leaked. We then design a dynamic reference gradient aggregation algorithm to mitigate the poisoning attack in FL, dynamically dividing the sub-gradients of each round of local uploads by clustering the gradients of different local uploads. Furthermore, the malicious and benign gradients are further separated and the optimal global model is obtained by iterative updating. We proved the security of the scheme theoretically, and verified the effectiveness of the scheme through experiments. The accuracy of the proposed scheme is at least 80% higher than that of the scheme without anti-poisoning measures.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信