FedCSA: Enhancing Federated Unlearning Efficiency Through Adaptive Clustering Under Data Heterogeneity

Abstract

In the digital era, escalating concerns over personal privacy and social security have led to the advocacy for the “right to be forgotten”, a principle that empowers individuals to request the deletion of their personal data from online platforms. Consequently, machine unlearning (MU) has been proposed as a method for targeted data deletion within machine learning models. However, MU encounters difficulties in distributed learning environments, such as federated learning (FL), where direct access to data is restricted. Federated unlearning (FU) has been developed in response, aiming to facilitate the process of data deletion requests from clients within FL frameworks. Despite advancements, FU methods based on approximate unlearning present a risk of potential data breaches, while methods reliant on retraining necessitate either complete or repeated retraining of clients, which is inefficient. Addressing these challenges, we introduce the federated cluster slicing algorithm (FedCSA), a novel FU strategy that achieves precision and efficiency in data unlearning. FedCSA organizes clients into distinct slices based on model deviation values, facilitating targeted retraining of local models upon unlearning requests. This method not only ensures consistency in the independent and identically distributed degree across slices but also improves unlearning efficiency and maintains global model accuracy. Moreover, FedCSA features an adaptive clustering mechanism that autonomously determines the optimal number of slices, optimizing the unlearning process. Our empirical analysis, conducted across the MNIST, Fashion-MNIST, and CIFAR-10 datasets, underscores FedCSA's superior performance. FedCSA exhibits a fourfold increase in unlearning efficiency compared to traditional retraining methods. Furthermore, when juxtaposed with the sharded, isolated, sliced, and aggregated technique, FedCSA demonstrates a 4%–5% enhancement in global model accuracy. These findings corroborate the efficacy of FedCSA.