{"title":"FedCLCC:基于对比学习和条件计算的边缘云协作个性化联合学习算法","authors":"Kangning Yin , Xinhui Ji , Yan Wang , Zhiguo Wang","doi":"10.1016/j.dt.2024.08.015","DOIUrl":null,"url":null,"abstract":"<div><div>Federated learning (FL) is a distributed machine learning paradigm for edge cloud computing. FL can facilitate data-driven decision-making in tactical scenarios, effectively addressing both data volume and infrastructure challenges in edge environments. However, the diversity of clients in edge cloud computing presents significant challenges for FL. Personalized federated learning (pFL) received considerable attention in recent years. One example of pFL involves exploiting the global and local information in the local model. Current pFL algorithms experience limitations such as slow convergence speed, catastrophic forgetting, and poor performance in complex tasks, which still have significant shortcomings compared to the centralized learning. To achieve high pFL performance, we propose FedCLCC: Federated Contrastive Learning and Conditional Computing. The core of FedCLCC is the use of contrastive learning and conditional computing. Contrastive learning determines the feature representation similarity to adjust the local model. Conditional computing separates the global and local information and feeds it to their corresponding heads for global and local handling. Our comprehensive experiments demonstrate that FedCLCC outperforms other state-of-the-art FL algorithms.</div></div>","PeriodicalId":58209,"journal":{"name":"Defence Technology(防务技术)","volume":"43 ","pages":"Pages 80-93"},"PeriodicalIF":5.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"FedCLCC: A personalized federated learning algorithm for edge cloud collaboration based on contrastive learning and conditional computing\",\"authors\":\"Kangning Yin , Xinhui Ji , Yan Wang , Zhiguo Wang\",\"doi\":\"10.1016/j.dt.2024.08.015\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Federated learning (FL) is a distributed machine learning paradigm for edge cloud computing. FL can facilitate data-driven decision-making in tactical scenarios, effectively addressing both data volume and infrastructure challenges in edge environments. However, the diversity of clients in edge cloud computing presents significant challenges for FL. Personalized federated learning (pFL) received considerable attention in recent years. One example of pFL involves exploiting the global and local information in the local model. Current pFL algorithms experience limitations such as slow convergence speed, catastrophic forgetting, and poor performance in complex tasks, which still have significant shortcomings compared to the centralized learning. To achieve high pFL performance, we propose FedCLCC: Federated Contrastive Learning and Conditional Computing. The core of FedCLCC is the use of contrastive learning and conditional computing. Contrastive learning determines the feature representation similarity to adjust the local model. Conditional computing separates the global and local information and feeds it to their corresponding heads for global and local handling. Our comprehensive experiments demonstrate that FedCLCC outperforms other state-of-the-art FL algorithms.</div></div>\",\"PeriodicalId\":58209,\"journal\":{\"name\":\"Defence Technology(防务技术)\",\"volume\":\"43 \",\"pages\":\"Pages 80-93\"},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Defence Technology(防务技术)\",\"FirstCategoryId\":\"1087\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2214914724002009\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Defence Technology(防务技术)","FirstCategoryId":"1087","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2214914724002009","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
FedCLCC: A personalized federated learning algorithm for edge cloud collaboration based on contrastive learning and conditional computing
Federated learning (FL) is a distributed machine learning paradigm for edge cloud computing. FL can facilitate data-driven decision-making in tactical scenarios, effectively addressing both data volume and infrastructure challenges in edge environments. However, the diversity of clients in edge cloud computing presents significant challenges for FL. Personalized federated learning (pFL) received considerable attention in recent years. One example of pFL involves exploiting the global and local information in the local model. Current pFL algorithms experience limitations such as slow convergence speed, catastrophic forgetting, and poor performance in complex tasks, which still have significant shortcomings compared to the centralized learning. To achieve high pFL performance, we propose FedCLCC: Federated Contrastive Learning and Conditional Computing. The core of FedCLCC is the use of contrastive learning and conditional computing. Contrastive learning determines the feature representation similarity to adjust the local model. Conditional computing separates the global and local information and feeds it to their corresponding heads for global and local handling. Our comprehensive experiments demonstrate that FedCLCC outperforms other state-of-the-art FL algorithms.
Defence Technology(防务技术)Mechanical Engineering, Control and Systems Engineering, Industrial and Manufacturing Engineering
CiteScore
8.70
自引率
0.00%
发文量
728
审稿时长
25 days
期刊介绍:
Defence Technology, a peer reviewed journal, is published monthly and aims to become the best international academic exchange platform for the research related to defence technology. It publishes original research papers having direct bearing on defence, with a balanced coverage on analytical, experimental, numerical simulation and applied investigations. It covers various disciplines of science, technology and engineering.