Acceleration offloading for differential privacy protection based on federated learning in edge intelligent controllers

IF 6.2 2区 计算机科学 Q1 COMPUTER SCIENCE, THEORY & METHODS
{"title":"Acceleration offloading for differential privacy protection based on federated learning in edge intelligent controllers","authors":"","doi":"10.1016/j.future.2024.107526","DOIUrl":null,"url":null,"abstract":"<div><div>When implementing Federated Learning (FL) on Edge Intelligence Controllers (EIC) in the Industrial Internet of Things (IIoT), it is important to consider the limitations of the EICs’ computational capabilities and to address potential privacy concerns. For the efficient and secure implementation of FL on EICs, three key issues require attention: (i) efficient deployment on EICs with limited computational capacity, (ii) avoiding privacy issues that arise from offloading strategies when using offloading to accelerate, and (iii) mitigating privacy leaks that may result from disclosed parameters. To address the aforementioned concerns, this paper proposes a task offloading model called <em>FedOffloading</em>. Employing Deep Reinforcement Learning (DRL) techniques, <em>FedOffloading</em> accelerates EIC training by offloading the training tasks of the model to the Edge servers (ES). It utilizes the Laplace distribution to safeguard the privacy of the offloading strategies. Meanwhile, to prevent privacy breaches caused by disclosed parameters, <em>FedOffloading</em> allows EICs to inject different levels of artificial noise before transmitting training data. Experimental studies conducted on a test platform reveal that, compared to classical FL, <em>FedOffloading</em> can reduce training time by 54.70%, and even up to 78.06% when training larger models. The <em>Security Module</em> effectively protects the offloading strategies, meeting privacy requirements while also minimizing training time. In addition, to prevent privacy leakage caused by EICs, we introduce noise in the parameters disclosed during training, and show that the intermediate activation data is more susceptible to noise.</div></div>","PeriodicalId":55132,"journal":{"name":"Future Generation Computer Systems-The International Journal of Escience","volume":null,"pages":null},"PeriodicalIF":6.2000,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Future Generation Computer Systems-The International Journal of Escience","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167739X24004904","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0

Abstract

When implementing Federated Learning (FL) on Edge Intelligence Controllers (EIC) in the Industrial Internet of Things (IIoT), it is important to consider the limitations of the EICs’ computational capabilities and to address potential privacy concerns. For the efficient and secure implementation of FL on EICs, three key issues require attention: (i) efficient deployment on EICs with limited computational capacity, (ii) avoiding privacy issues that arise from offloading strategies when using offloading to accelerate, and (iii) mitigating privacy leaks that may result from disclosed parameters. To address the aforementioned concerns, this paper proposes a task offloading model called FedOffloading. Employing Deep Reinforcement Learning (DRL) techniques, FedOffloading accelerates EIC training by offloading the training tasks of the model to the Edge servers (ES). It utilizes the Laplace distribution to safeguard the privacy of the offloading strategies. Meanwhile, to prevent privacy breaches caused by disclosed parameters, FedOffloading allows EICs to inject different levels of artificial noise before transmitting training data. Experimental studies conducted on a test platform reveal that, compared to classical FL, FedOffloading can reduce training time by 54.70%, and even up to 78.06% when training larger models. The Security Module effectively protects the offloading strategies, meeting privacy requirements while also minimizing training time. In addition, to prevent privacy leakage caused by EICs, we introduce noise in the parameters disclosed during training, and show that the intermediate activation data is more susceptible to noise.
边缘智能控制器中基于联合学习的差异化隐私保护加速卸载
在工业物联网(IIoT)中的边缘智能控制器(EIC)上实施联合学习(FL)时,必须考虑到 EIC 计算能力的限制,并解决潜在的隐私问题。要在 EIC 上高效、安全地实施 FL,需要注意三个关键问题:(i) 在计算能力有限的 EIC 上高效部署;(ii) 在使用卸载加速时避免卸载策略引起的隐私问题;(iii) 减少披露参数可能导致的隐私泄露。为了解决上述问题,本文提出了一种名为 FedOffloading 的任务卸载模型。FedOffloading 采用深度强化学习(DRL)技术,通过将模型的训练任务卸载到边缘服务器(ES)来加速 EIC 训练。它利用拉普拉斯分布来保护卸载策略的隐私。同时,为防止因参数泄露而造成隐私泄露,FedOffloading 允许 EIC 在传输训练数据前注入不同程度的人工噪声。在测试平台上进行的实验研究表明,与经典的 FL 相比,FedOffloading 可以减少 54.70% 的训练时间,在训练较大模型时甚至可以减少 78.06% 的时间。安全模块可有效保护卸载策略,在满足隐私要求的同时最大限度地缩短训练时间。此外,为了防止 EIC 导致的隐私泄露,我们在训练过程中为公开的参数引入了噪声,结果表明中间激活数据更容易受到噪声的影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
19.90
自引率
2.70%
发文量
376
审稿时长
10.6 months
期刊介绍: Computing infrastructures and systems are constantly evolving, resulting in increasingly complex and collaborative scientific applications. To cope with these advancements, there is a growing need for collaborative tools that can effectively map, control, and execute these applications. Furthermore, with the explosion of Big Data, there is a requirement for innovative methods and infrastructures to collect, analyze, and derive meaningful insights from the vast amount of data generated. This necessitates the integration of computational and storage capabilities, databases, sensors, and human collaboration. Future Generation Computer Systems aims to pioneer advancements in distributed systems, collaborative environments, high-performance computing, and Big Data analytics. It strives to stay at the forefront of developments in grids, clouds, and the Internet of Things (IoT) to effectively address the challenges posed by these wide-area, fully distributed sensing and computing systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信