Enhancing Federated Learning Performance on Heterogeneous IoT Devices Using Generative Artificial Intelligence With Resource Scheduling

Abstract

The integration of federated learning (FL) with the Internet of Things (IoT) represents an advanced technological trend, combining the extensive connectivity of IoT with the powerful processing capabilities of FL to drive innovation and optimization across multiple domains. Given the heterogeneity of IoT devices and the variability in data distribution, developing strategies to enhance FL performance without overly burdening resource-constrained devices is crucial. This article proposes an FL algorithm based on generative artificial intelligence (GAI) for IoT devices with extreme heterogeneity in data and resources. The algorithm utilizes pretrained GAI models to generate new data, aligning the data distributions of individual IoT devices closer to independent and identically distributed (i.i.d.), thereby effectively reducing the heterogeneity of local data. Additionally, the proposed algorithm incorporates data synthesis and resource scheduling strategies to mitigate the heterogeneity of local device resources. Finally, we formulate a joint optimization problem aimed at minimizing total energy consumption while maximizing FL performance. Experimental results demonstrate that, under significant resource and data distribution disparities, most existing solutions struggle to converge, whereas the proposed method converges and achieves superior performance. Compared to existing GAI-based approaches, our method significantly reduces latency and energy consumption.