An Adaptive Federated Fuzzy C-Means Clustering With Nonindependently and Identically Distributed Data

IF 8.6 1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Longmei Li;Wei Lu;Witold Pedrycz
{"title":"An Adaptive Federated Fuzzy C-Means Clustering With Nonindependently and Identically Distributed Data","authors":"Longmei Li;Wei Lu;Witold Pedrycz","doi":"10.1109/TSMC.2025.3547350","DOIUrl":null,"url":null,"abstract":"Federated Fuzzy C-Means (FCM) has received considerable attention due to the increasing need for privacy-conscious data analysis across diverse domains and sources in many real-world applications. Recent developments in federated FCM, however, are still in their infancy and largely unexplored. These methods struggle to handle nonindependent and identically distributed (non-iid) data. Moreover, critical hyperparameters, such as the number of iterations for local updates, are typically set manually, which can significantly affect the performance of federated clustering. To address these challenges, we introduce an Adaptive Federated FCM with an auxiliary model, named AF-FCM. In this approach, prior information from the auxiliary model, along with a proximal term in the local objective, mitigates the effects of the non-iid environment, enhancing both model robustness and effectiveness. Critical hyperparameters are adaptively adjusted using a proposed adaptive particle swarm optimization (APSO) algorithm, guided by a carefully designed fitness function. Within APSO, a nonlinear regression function adjusts the inertia weight, reducing the risk of convergence to local optima. In AF-FCM, global prototypes are refined using momentum gradient descent (MGD). Numerical experiments highlight the effectiveness and generalization performance of AF-FCM across various conditions, including heterogeneity variations, the number of clients, and the number of clusters. Comparative analysis against state-of-the-art federated clustering baseline methods validates the competitive performance of AF-FCM.","PeriodicalId":48915,"journal":{"name":"IEEE Transactions on Systems Man Cybernetics-Systems","volume":"55 6","pages":"4015-4028"},"PeriodicalIF":8.6000,"publicationDate":"2025-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Systems Man Cybernetics-Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10934094/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Federated Fuzzy C-Means (FCM) has received considerable attention due to the increasing need for privacy-conscious data analysis across diverse domains and sources in many real-world applications. Recent developments in federated FCM, however, are still in their infancy and largely unexplored. These methods struggle to handle nonindependent and identically distributed (non-iid) data. Moreover, critical hyperparameters, such as the number of iterations for local updates, are typically set manually, which can significantly affect the performance of federated clustering. To address these challenges, we introduce an Adaptive Federated FCM with an auxiliary model, named AF-FCM. In this approach, prior information from the auxiliary model, along with a proximal term in the local objective, mitigates the effects of the non-iid environment, enhancing both model robustness and effectiveness. Critical hyperparameters are adaptively adjusted using a proposed adaptive particle swarm optimization (APSO) algorithm, guided by a carefully designed fitness function. Within APSO, a nonlinear regression function adjusts the inertia weight, reducing the risk of convergence to local optima. In AF-FCM, global prototypes are refined using momentum gradient descent (MGD). Numerical experiments highlight the effectiveness and generalization performance of AF-FCM across various conditions, including heterogeneity variations, the number of clients, and the number of clusters. Comparative analysis against state-of-the-art federated clustering baseline methods validates the competitive performance of AF-FCM.
非独立同分布数据的自适应联邦模糊c均值聚类
由于在许多实际应用中跨不同领域和来源的具有隐私意识的数据分析的需求日益增加,联邦模糊c -均值(FCM)受到了相当大的关注。然而,联合FCM的最新发展仍处于起步阶段,大部分未被探索。这些方法难以处理非独立和同分布(non-iid)数据。此外,关键的超参数(例如本地更新的迭代次数)通常是手动设置的,这可能会严重影响联邦集群的性能。为了应对这些挑战,我们引入了一种带有辅助模型的自适应联邦FCM,称为AF-FCM。在这种方法中,来自辅助模型的先验信息,以及局部目标的近端项,减轻了非外部环境的影响,增强了模型的鲁棒性和有效性。在精心设计的适应度函数的指导下,采用提出的自适应粒子群优化(APSO)算法自适应调整关键超参数。在APSO中,非线性回归函数调整惯性权重,降低收敛到局部最优的风险。在AF-FCM中,使用动量梯度下降(MGD)来细化全局原型。数值实验强调了AF-FCM在各种条件下的有效性和泛化性能,包括异质性变化,客户端数量和集群数量。与最先进的联邦聚类基线方法进行比较分析,验证了AF-FCM的竞争性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Systems Man Cybernetics-Systems
IEEE Transactions on Systems Man Cybernetics-Systems AUTOMATION & CONTROL SYSTEMS-COMPUTER SCIENCE, CYBERNETICS
CiteScore
18.50
自引率
11.50%
发文量
812
审稿时长
6 months
期刊介绍: The IEEE Transactions on Systems, Man, and Cybernetics: Systems encompasses the fields of systems engineering, covering issue formulation, analysis, and modeling throughout the systems engineering lifecycle phases. It addresses decision-making, issue interpretation, systems management, processes, and various methods such as optimization, modeling, and simulation in the development and deployment of large systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信