Lewis Petch, Ahmed Moustafa, Xinhui Ma, Mohammad Yasser
{"title":"HFL-GAN: scalable hierarchical federated learning GAN for high quantity heterogeneous clients","authors":"Lewis Petch, Ahmed Moustafa, Xinhui Ma, Mohammad Yasser","doi":"10.1007/s10489-024-05924-x","DOIUrl":null,"url":null,"abstract":"<div><p>This paper introduces a novel approach for training generative adversarial networks using federated machine learning. Generative adversarial networks have gained plenty of attention in the research community especially with their abilities to produce high quality synthetic data for a variety of use-cases. Yet, when combined with federated learning, those models suffer from degradation in both training time and quality of results. To address this challenge, this paper introduces a novel approach that uses hierarchical learning techniques to enable the efficient training of federated GAN models. The proposed approach introduces an innovative mechanism that dynamically clusters participant clients to edge servers as well as a novel multi-generator GAN architecture that utilizes non-identical model aggregation stages. The proposed approach has been evaluated on a number of benchmark datasets to measure its performance on higher numbers of participating clients. The results show that HFL-GAN outperforms other comparative state-of-the-art approaches in the training of GAN models in complex non-IID federated learning settings.</p></div>","PeriodicalId":8041,"journal":{"name":"Applied Intelligence","volume":"55 2","pages":""},"PeriodicalIF":3.4000,"publicationDate":"2024-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s10489-024-05924-x.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Intelligence","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10489-024-05924-x","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
This paper introduces a novel approach for training generative adversarial networks using federated machine learning. Generative adversarial networks have gained plenty of attention in the research community especially with their abilities to produce high quality synthetic data for a variety of use-cases. Yet, when combined with federated learning, those models suffer from degradation in both training time and quality of results. To address this challenge, this paper introduces a novel approach that uses hierarchical learning techniques to enable the efficient training of federated GAN models. The proposed approach introduces an innovative mechanism that dynamically clusters participant clients to edge servers as well as a novel multi-generator GAN architecture that utilizes non-identical model aggregation stages. The proposed approach has been evaluated on a number of benchmark datasets to measure its performance on higher numbers of participating clients. The results show that HFL-GAN outperforms other comparative state-of-the-art approaches in the training of GAN models in complex non-IID federated learning settings.
本文介绍了一种利用联合机器学习训练生成式对抗网络的新方法。生成式对抗网络在研究界获得了广泛的关注,尤其是它们能为各种用例生成高质量的合成数据。然而,当这些模型与联合学习相结合时,其训练时间和结果质量都会下降。为了应对这一挑战,本文介绍了一种新方法,它使用分层学习技术来实现联合 GAN 模型的高效训练。所提出的方法引入了一种创新机制,可将参与者客户端动态集群到边缘服务器,还引入了一种利用非相同模型聚合阶段的新型多生成器 GAN 架构。我们在一些基准数据集上对所提出的方法进行了评估,以衡量其在更多参与客户端时的性能。结果表明,在复杂的非 IID 联合学习环境中,HFL-GAN 在训练 GAN 模型方面的表现优于其他最先进的比较方法。
期刊介绍:
With a focus on research in artificial intelligence and neural networks, this journal addresses issues involving solutions of real-life manufacturing, defense, management, government and industrial problems which are too complex to be solved through conventional approaches and require the simulation of intelligent thought processes, heuristics, applications of knowledge, and distributed and parallel processing. The integration of these multiple approaches in solving complex problems is of particular importance.
The journal presents new and original research and technological developments, addressing real and complex issues applicable to difficult problems. It provides a medium for exchanging scientific research and technological achievements accomplished by the international community.