联邦边缘学习中抑制不公平能源消耗和偏差模型的新方法

IF 5.3 2区 计算机科学 Q1 TELECOMMUNICATIONS
Abdullatif Albaseer;Abegaz Mohammed Seid;Mohamed Abdallah;Ala Al-Fuqaha;Aiman Erbad
{"title":"联邦边缘学习中抑制不公平能源消耗和偏差模型的新方法","authors":"Abdullatif Albaseer;Abegaz Mohammed Seid;Mohamed Abdallah;Ala Al-Fuqaha;Aiman Erbad","doi":"10.1109/TGCN.2024.3350735","DOIUrl":null,"url":null,"abstract":"Researchers and practitioners have recently shown interest in deploying federated learning for enhanced privacy preservation in wireless edge networks. In such settings, resource-constrained user equipment (UE) often experiences unfair energy consumption and performance degradation of machine learning models due to data heterogeneity and constrained computation and communication resources. Several approaches have been proposed in the literature to reduce energy consumption, including scheduling a subset of UEs to undertake learning tasks based on their energy budgets. However, these approaches are inherently unfair as the frequently selected UEs rapidly deplete their energy and are rendered inaccessible. Furthermore, the server may be unable to capture the incongruent data distribution, resulting in a biased model. In this paper, we propose a novel approach that addresses those challenges, considering the historical participation of the UEs to ensure that all the training data of the UEs are incorporated into the global model. Specifically, using Jain’s fairness index, we formulate the overall optimization problem, decompose it into two sub-problems, and iteratively solve the sub-problems. Towards this end, we partition the optimization variables into two-blocks; one on the server-side and another on the UEs’ side. The server-side algorithm aims to balance energy usage and learning performance, while the client-side algorithm seeks to optimize CPU frequency and transmit power. Extensive experiments using two realistic datasets, FEMNIST and CIFAR-10, indicate that the proposed algorithms minimize overall energy while curbing unfair energy consumption between the UEs, accelerating convergence rates, and significantly enhancing local accuracy for all UEs.","PeriodicalId":13052,"journal":{"name":"IEEE Transactions on Green Communications and Networking","volume":"8 2","pages":"865-877"},"PeriodicalIF":5.3000,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Novel Approach for Curbing Unfair Energy Consumption and Biased Model in Federated Edge Learning\",\"authors\":\"Abdullatif Albaseer;Abegaz Mohammed Seid;Mohamed Abdallah;Ala Al-Fuqaha;Aiman Erbad\",\"doi\":\"10.1109/TGCN.2024.3350735\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Researchers and practitioners have recently shown interest in deploying federated learning for enhanced privacy preservation in wireless edge networks. In such settings, resource-constrained user equipment (UE) often experiences unfair energy consumption and performance degradation of machine learning models due to data heterogeneity and constrained computation and communication resources. Several approaches have been proposed in the literature to reduce energy consumption, including scheduling a subset of UEs to undertake learning tasks based on their energy budgets. However, these approaches are inherently unfair as the frequently selected UEs rapidly deplete their energy and are rendered inaccessible. Furthermore, the server may be unable to capture the incongruent data distribution, resulting in a biased model. In this paper, we propose a novel approach that addresses those challenges, considering the historical participation of the UEs to ensure that all the training data of the UEs are incorporated into the global model. Specifically, using Jain’s fairness index, we formulate the overall optimization problem, decompose it into two sub-problems, and iteratively solve the sub-problems. Towards this end, we partition the optimization variables into two-blocks; one on the server-side and another on the UEs’ side. The server-side algorithm aims to balance energy usage and learning performance, while the client-side algorithm seeks to optimize CPU frequency and transmit power. Extensive experiments using two realistic datasets, FEMNIST and CIFAR-10, indicate that the proposed algorithms minimize overall energy while curbing unfair energy consumption between the UEs, accelerating convergence rates, and significantly enhancing local accuracy for all UEs.\",\"PeriodicalId\":13052,\"journal\":{\"name\":\"IEEE Transactions on Green Communications and Networking\",\"volume\":\"8 2\",\"pages\":\"865-877\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-01-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Green Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10382668/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Green Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10382668/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

最近,研究人员和从业人员对在无线边缘网络中部署联合学习以加强隐私保护表现出了浓厚的兴趣。在这种情况下,资源受限的用户设备(UE)往往会因为数据异构、计算和通信资源受限而导致不公平的能耗和机器学习模型的性能下降。文献中提出了几种降低能耗的方法,包括根据 UE 的能耗预算调度其子集来执行学习任务。然而,这些方法本质上是不公平的,因为经常被选中的 UE 会迅速耗尽能量而无法访问。此外,服务器可能无法捕捉到不一致的数据分布,从而导致模型出现偏差。在本文中,我们提出了一种新方法来应对这些挑战,即考虑 UE 的历史参与情况,确保将 UE 的所有训练数据纳入全局模型。具体来说,我们使用 Jain 的公平性指数来制定整体优化问题,将其分解为两个子问题,并对子问题进行迭代求解。为此,我们将优化变量分为两块:一块在服务器端,另一块在 UE 端。服务器端算法旨在平衡能源使用和学习性能,而客户端算法旨在优化 CPU 频率和发射功率。使用 FEMNIST 和 CIFAR-10 这两个现实数据集进行的广泛实验表明,所提出的算法最大限度地降低了总体能耗,同时抑制了 UE 之间不公平的能耗,加快了收敛速度,并显著提高了所有 UE 的局部准确性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Novel Approach for Curbing Unfair Energy Consumption and Biased Model in Federated Edge Learning
Researchers and practitioners have recently shown interest in deploying federated learning for enhanced privacy preservation in wireless edge networks. In such settings, resource-constrained user equipment (UE) often experiences unfair energy consumption and performance degradation of machine learning models due to data heterogeneity and constrained computation and communication resources. Several approaches have been proposed in the literature to reduce energy consumption, including scheduling a subset of UEs to undertake learning tasks based on their energy budgets. However, these approaches are inherently unfair as the frequently selected UEs rapidly deplete their energy and are rendered inaccessible. Furthermore, the server may be unable to capture the incongruent data distribution, resulting in a biased model. In this paper, we propose a novel approach that addresses those challenges, considering the historical participation of the UEs to ensure that all the training data of the UEs are incorporated into the global model. Specifically, using Jain’s fairness index, we formulate the overall optimization problem, decompose it into two sub-problems, and iteratively solve the sub-problems. Towards this end, we partition the optimization variables into two-blocks; one on the server-side and another on the UEs’ side. The server-side algorithm aims to balance energy usage and learning performance, while the client-side algorithm seeks to optimize CPU frequency and transmit power. Extensive experiments using two realistic datasets, FEMNIST and CIFAR-10, indicate that the proposed algorithms minimize overall energy while curbing unfair energy consumption between the UEs, accelerating convergence rates, and significantly enhancing local accuracy for all UEs.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Green Communications and Networking
IEEE Transactions on Green Communications and Networking Computer Science-Computer Networks and Communications
CiteScore
9.30
自引率
6.20%
发文量
181
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信