Abdullatif Albaseer;Abegaz Mohammed Seid;Mohamed Abdallah;Ala Al-Fuqaha;Aiman Erbad
{"title":"联邦边缘学习中抑制不公平能源消耗和偏差模型的新方法","authors":"Abdullatif Albaseer;Abegaz Mohammed Seid;Mohamed Abdallah;Ala Al-Fuqaha;Aiman Erbad","doi":"10.1109/TGCN.2024.3350735","DOIUrl":null,"url":null,"abstract":"Researchers and practitioners have recently shown interest in deploying federated learning for enhanced privacy preservation in wireless edge networks. In such settings, resource-constrained user equipment (UE) often experiences unfair energy consumption and performance degradation of machine learning models due to data heterogeneity and constrained computation and communication resources. Several approaches have been proposed in the literature to reduce energy consumption, including scheduling a subset of UEs to undertake learning tasks based on their energy budgets. However, these approaches are inherently unfair as the frequently selected UEs rapidly deplete their energy and are rendered inaccessible. Furthermore, the server may be unable to capture the incongruent data distribution, resulting in a biased model. In this paper, we propose a novel approach that addresses those challenges, considering the historical participation of the UEs to ensure that all the training data of the UEs are incorporated into the global model. Specifically, using Jain’s fairness index, we formulate the overall optimization problem, decompose it into two sub-problems, and iteratively solve the sub-problems. Towards this end, we partition the optimization variables into two-blocks; one on the server-side and another on the UEs’ side. The server-side algorithm aims to balance energy usage and learning performance, while the client-side algorithm seeks to optimize CPU frequency and transmit power. Extensive experiments using two realistic datasets, FEMNIST and CIFAR-10, indicate that the proposed algorithms minimize overall energy while curbing unfair energy consumption between the UEs, accelerating convergence rates, and significantly enhancing local accuracy for all UEs.","PeriodicalId":13052,"journal":{"name":"IEEE Transactions on Green Communications and Networking","volume":"8 2","pages":"865-877"},"PeriodicalIF":5.3000,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Novel Approach for Curbing Unfair Energy Consumption and Biased Model in Federated Edge Learning\",\"authors\":\"Abdullatif Albaseer;Abegaz Mohammed Seid;Mohamed Abdallah;Ala Al-Fuqaha;Aiman Erbad\",\"doi\":\"10.1109/TGCN.2024.3350735\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Researchers and practitioners have recently shown interest in deploying federated learning for enhanced privacy preservation in wireless edge networks. In such settings, resource-constrained user equipment (UE) often experiences unfair energy consumption and performance degradation of machine learning models due to data heterogeneity and constrained computation and communication resources. Several approaches have been proposed in the literature to reduce energy consumption, including scheduling a subset of UEs to undertake learning tasks based on their energy budgets. However, these approaches are inherently unfair as the frequently selected UEs rapidly deplete their energy and are rendered inaccessible. Furthermore, the server may be unable to capture the incongruent data distribution, resulting in a biased model. In this paper, we propose a novel approach that addresses those challenges, considering the historical participation of the UEs to ensure that all the training data of the UEs are incorporated into the global model. Specifically, using Jain’s fairness index, we formulate the overall optimization problem, decompose it into two sub-problems, and iteratively solve the sub-problems. Towards this end, we partition the optimization variables into two-blocks; one on the server-side and another on the UEs’ side. The server-side algorithm aims to balance energy usage and learning performance, while the client-side algorithm seeks to optimize CPU frequency and transmit power. Extensive experiments using two realistic datasets, FEMNIST and CIFAR-10, indicate that the proposed algorithms minimize overall energy while curbing unfair energy consumption between the UEs, accelerating convergence rates, and significantly enhancing local accuracy for all UEs.\",\"PeriodicalId\":13052,\"journal\":{\"name\":\"IEEE Transactions on Green Communications and Networking\",\"volume\":\"8 2\",\"pages\":\"865-877\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-01-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Green Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10382668/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Green Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10382668/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
Novel Approach for Curbing Unfair Energy Consumption and Biased Model in Federated Edge Learning
Researchers and practitioners have recently shown interest in deploying federated learning for enhanced privacy preservation in wireless edge networks. In such settings, resource-constrained user equipment (UE) often experiences unfair energy consumption and performance degradation of machine learning models due to data heterogeneity and constrained computation and communication resources. Several approaches have been proposed in the literature to reduce energy consumption, including scheduling a subset of UEs to undertake learning tasks based on their energy budgets. However, these approaches are inherently unfair as the frequently selected UEs rapidly deplete their energy and are rendered inaccessible. Furthermore, the server may be unable to capture the incongruent data distribution, resulting in a biased model. In this paper, we propose a novel approach that addresses those challenges, considering the historical participation of the UEs to ensure that all the training data of the UEs are incorporated into the global model. Specifically, using Jain’s fairness index, we formulate the overall optimization problem, decompose it into two sub-problems, and iteratively solve the sub-problems. Towards this end, we partition the optimization variables into two-blocks; one on the server-side and another on the UEs’ side. The server-side algorithm aims to balance energy usage and learning performance, while the client-side algorithm seeks to optimize CPU frequency and transmit power. Extensive experiments using two realistic datasets, FEMNIST and CIFAR-10, indicate that the proposed algorithms minimize overall energy while curbing unfair energy consumption between the UEs, accelerating convergence rates, and significantly enhancing local accuracy for all UEs.