{"title":"Acceleration offloading for differential privacy protection based on federated learning in edge intelligent controllers","authors":"","doi":"10.1016/j.future.2024.107526","DOIUrl":null,"url":null,"abstract":"<div><div>When implementing Federated Learning (FL) on Edge Intelligence Controllers (EIC) in the Industrial Internet of Things (IIoT), it is important to consider the limitations of the EICs’ computational capabilities and to address potential privacy concerns. For the efficient and secure implementation of FL on EICs, three key issues require attention: (i) efficient deployment on EICs with limited computational capacity, (ii) avoiding privacy issues that arise from offloading strategies when using offloading to accelerate, and (iii) mitigating privacy leaks that may result from disclosed parameters. To address the aforementioned concerns, this paper proposes a task offloading model called <em>FedOffloading</em>. Employing Deep Reinforcement Learning (DRL) techniques, <em>FedOffloading</em> accelerates EIC training by offloading the training tasks of the model to the Edge servers (ES). It utilizes the Laplace distribution to safeguard the privacy of the offloading strategies. Meanwhile, to prevent privacy breaches caused by disclosed parameters, <em>FedOffloading</em> allows EICs to inject different levels of artificial noise before transmitting training data. Experimental studies conducted on a test platform reveal that, compared to classical FL, <em>FedOffloading</em> can reduce training time by 54.70%, and even up to 78.06% when training larger models. The <em>Security Module</em> effectively protects the offloading strategies, meeting privacy requirements while also minimizing training time. In addition, to prevent privacy leakage caused by EICs, we introduce noise in the parameters disclosed during training, and show that the intermediate activation data is more susceptible to noise.</div></div>","PeriodicalId":55132,"journal":{"name":"Future Generation Computer Systems-The International Journal of Escience","volume":null,"pages":null},"PeriodicalIF":6.2000,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Future Generation Computer Systems-The International Journal of Escience","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167739X24004904","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0
Abstract
When implementing Federated Learning (FL) on Edge Intelligence Controllers (EIC) in the Industrial Internet of Things (IIoT), it is important to consider the limitations of the EICs’ computational capabilities and to address potential privacy concerns. For the efficient and secure implementation of FL on EICs, three key issues require attention: (i) efficient deployment on EICs with limited computational capacity, (ii) avoiding privacy issues that arise from offloading strategies when using offloading to accelerate, and (iii) mitigating privacy leaks that may result from disclosed parameters. To address the aforementioned concerns, this paper proposes a task offloading model called FedOffloading. Employing Deep Reinforcement Learning (DRL) techniques, FedOffloading accelerates EIC training by offloading the training tasks of the model to the Edge servers (ES). It utilizes the Laplace distribution to safeguard the privacy of the offloading strategies. Meanwhile, to prevent privacy breaches caused by disclosed parameters, FedOffloading allows EICs to inject different levels of artificial noise before transmitting training data. Experimental studies conducted on a test platform reveal that, compared to classical FL, FedOffloading can reduce training time by 54.70%, and even up to 78.06% when training larger models. The Security Module effectively protects the offloading strategies, meeting privacy requirements while also minimizing training time. In addition, to prevent privacy leakage caused by EICs, we introduce noise in the parameters disclosed during training, and show that the intermediate activation data is more susceptible to noise.
期刊介绍:
Computing infrastructures and systems are constantly evolving, resulting in increasingly complex and collaborative scientific applications. To cope with these advancements, there is a growing need for collaborative tools that can effectively map, control, and execute these applications.
Furthermore, with the explosion of Big Data, there is a requirement for innovative methods and infrastructures to collect, analyze, and derive meaningful insights from the vast amount of data generated. This necessitates the integration of computational and storage capabilities, databases, sensors, and human collaboration.
Future Generation Computer Systems aims to pioneer advancements in distributed systems, collaborative environments, high-performance computing, and Big Data analytics. It strives to stay at the forefront of developments in grids, clouds, and the Internet of Things (IoT) to effectively address the challenges posed by these wide-area, fully distributed sensing and computing systems.