Atif Rizwan , Anam Nawaz Khan , Rashid Ahmad , Qazi Waqas Khan , Do Hyeun Kim
{"title":"Personalized hierarchical heterogeneous federated learning for thermal comfort prediction in smart buildings","authors":"Atif Rizwan , Anam Nawaz Khan , Rashid Ahmad , Qazi Waqas Khan , Do Hyeun Kim","doi":"10.1016/j.engappai.2024.109464","DOIUrl":null,"url":null,"abstract":"<div><div>Federated Learning (FL) is gaining significant traction due to its ability to provide security and privacy. In the FL paradigm, the global model is learned at the cloud through the consolidation of local model parameters instead of collecting local training data at the central node. This approach mitigates privacy leakage caused by the collection of sensitive information. However, it poses challenges to the convergence of the global model due to system and statistical heterogeneity. In this study, we propose a two-fold Personalized Hierarchical Heterogeneous FL (PHHFL) approach. It leverages a hierarchical structure to handle statistical heterogeneity and a normal distribution-based client selection to control model divergence in FL environment. PHHFL aims to use a maximum number of local features of each client and assign specific level in the hierarchy. Furthermore, to address model divergence caused by the nodes’ statistical heterogeneity, we propose a novel client selection strategy based on the performance distribution of the nodes. Experiments are conducted on thermal comfort datasets and a synthetic dataset with 12 and 10 clients, respectively. The results show that the proposed PHHFL outperforms in terms of accuracy, F1 score, and class-wise precision on both thermal comfort and synthetic datasets. The source code of the PHHFL model and datasets is available on <span><span>GitHub</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":7.5000,"publicationDate":"2024-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197624016221","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Federated Learning (FL) is gaining significant traction due to its ability to provide security and privacy. In the FL paradigm, the global model is learned at the cloud through the consolidation of local model parameters instead of collecting local training data at the central node. This approach mitigates privacy leakage caused by the collection of sensitive information. However, it poses challenges to the convergence of the global model due to system and statistical heterogeneity. In this study, we propose a two-fold Personalized Hierarchical Heterogeneous FL (PHHFL) approach. It leverages a hierarchical structure to handle statistical heterogeneity and a normal distribution-based client selection to control model divergence in FL environment. PHHFL aims to use a maximum number of local features of each client and assign specific level in the hierarchy. Furthermore, to address model divergence caused by the nodes’ statistical heterogeneity, we propose a novel client selection strategy based on the performance distribution of the nodes. Experiments are conducted on thermal comfort datasets and a synthetic dataset with 12 and 10 clients, respectively. The results show that the proposed PHHFL outperforms in terms of accuracy, F1 score, and class-wise precision on both thermal comfort and synthetic datasets. The source code of the PHHFL model and datasets is available on GitHub.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.