具有自适应模型参数聚合的分层联邦学习模型

IF 1.2 4区 计算机科学 Q4 COMPUTER SCIENCE, INFORMATION SYSTEMS
Zhuo Chen, Chuan Zhou, Yang Zhou
{"title":"具有自适应模型参数聚合的分层联邦学习模型","authors":"Zhuo Chen, Chuan Zhou, Yang Zhou","doi":"10.2298/csis220930026c","DOIUrl":null,"url":null,"abstract":"With the proposed Federated Learning (FL) paradigm based on the idea of ?data available but invisible?, participating nodes which create or hold data can perform local model training in a distributed manner, then a global model can be trained only by continuously aggregating model parameters or inter mediate results from different nodes, thereby achieving a balance between data privacy protection and data sharing. However, there are some challenges when deploying a FL model. First, there may be hierarchical associations between participating nodes, so that the datasets held by each node are no longer independent of each other. Secondly, due to the possible abnormal delay of data transmission, it can seriously influence the aggregation of model parameters. In response to the above challenges, this paper proposes a newly designed FL framework for the participating nodes with hierarchical associations. In this framework, we design an adaptive model parameter aggregation algorithm, which can dynamically decide the aggregation strategy according to the state of network connection between nodes in different layers. Additionally, we conduct a theoretical analysis of the convergence of the proposed FL frame work based on a non-convex objective function. Finally, the experimental results show that the proposed framework can be well applied to applications in different network connections, and can achieve faster model convergence efficiency while ensuring the accuracy of the model prediction.","PeriodicalId":50636,"journal":{"name":"Computer Science and Information Systems","volume":"1 1","pages":"1037-1060"},"PeriodicalIF":1.2000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"A hierarchical federated learning model with adaptive model parameter aggregation\",\"authors\":\"Zhuo Chen, Chuan Zhou, Yang Zhou\",\"doi\":\"10.2298/csis220930026c\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the proposed Federated Learning (FL) paradigm based on the idea of ?data available but invisible?, participating nodes which create or hold data can perform local model training in a distributed manner, then a global model can be trained only by continuously aggregating model parameters or inter mediate results from different nodes, thereby achieving a balance between data privacy protection and data sharing. However, there are some challenges when deploying a FL model. First, there may be hierarchical associations between participating nodes, so that the datasets held by each node are no longer independent of each other. Secondly, due to the possible abnormal delay of data transmission, it can seriously influence the aggregation of model parameters. In response to the above challenges, this paper proposes a newly designed FL framework for the participating nodes with hierarchical associations. In this framework, we design an adaptive model parameter aggregation algorithm, which can dynamically decide the aggregation strategy according to the state of network connection between nodes in different layers. Additionally, we conduct a theoretical analysis of the convergence of the proposed FL frame work based on a non-convex objective function. Finally, the experimental results show that the proposed framework can be well applied to applications in different network connections, and can achieve faster model convergence efficiency while ensuring the accuracy of the model prediction.\",\"PeriodicalId\":50636,\"journal\":{\"name\":\"Computer Science and Information Systems\",\"volume\":\"1 1\",\"pages\":\"1037-1060\"},\"PeriodicalIF\":1.2000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Science and Information Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.2298/csis220930026c\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Science and Information Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.2298/csis220930026c","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 1

摘要

基于“数据可用但不可见”的思想,提出了联邦学习(FL)范式。,创建或持有数据的参与节点可以以分布式的方式进行局部模型训练,则只需将来自不同节点的模型参数或中间结果不断聚合,即可训练出全局模型,从而实现数据隐私保护与数据共享的平衡。然而,在部署FL模型时存在一些挑战。首先,参与节点之间可能存在层次关联,因此每个节点持有的数据集不再相互独立。其次,由于数据传输可能出现异常延迟,会严重影响模型参数的聚合。针对上述挑战,本文提出了一种针对分层关联参与节点的新设计的FL框架。在该框架中,我们设计了一种自适应模型参数聚合算法,该算法可以根据不同层节点之间的网络连接状态动态决定聚合策略。此外,我们对基于非凸目标函数的FL框架的收敛性进行了理论分析。最后,实验结果表明,该框架可以很好地适用于不同网络连接的应用,在保证模型预测准确性的同时,可以实现更快的模型收敛效率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A hierarchical federated learning model with adaptive model parameter aggregation
With the proposed Federated Learning (FL) paradigm based on the idea of ?data available but invisible?, participating nodes which create or hold data can perform local model training in a distributed manner, then a global model can be trained only by continuously aggregating model parameters or inter mediate results from different nodes, thereby achieving a balance between data privacy protection and data sharing. However, there are some challenges when deploying a FL model. First, there may be hierarchical associations between participating nodes, so that the datasets held by each node are no longer independent of each other. Secondly, due to the possible abnormal delay of data transmission, it can seriously influence the aggregation of model parameters. In response to the above challenges, this paper proposes a newly designed FL framework for the participating nodes with hierarchical associations. In this framework, we design an adaptive model parameter aggregation algorithm, which can dynamically decide the aggregation strategy according to the state of network connection between nodes in different layers. Additionally, we conduct a theoretical analysis of the convergence of the proposed FL frame work based on a non-convex objective function. Finally, the experimental results show that the proposed framework can be well applied to applications in different network connections, and can achieve faster model convergence efficiency while ensuring the accuracy of the model prediction.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computer Science and Information Systems
Computer Science and Information Systems COMPUTER SCIENCE, INFORMATION SYSTEMS-COMPUTER SCIENCE, SOFTWARE ENGINEERING
CiteScore
2.30
自引率
21.40%
发文量
76
审稿时长
7.5 months
期刊介绍: About the journal Home page Contact information Aims and scope Indexing information Editorial policies ComSIS consortium Journal boards Managing board For authors Information for contributors Paper submission Article submission through OJS Copyright transfer form Download section For readers Forthcoming articles Current issue Archive Subscription For reviewers View and review submissions News Journal''s Facebook page Call for special issue New issue notification Aims and scope Computer Science and Information Systems (ComSIS) is an international refereed journal, published in Serbia. The objective of ComSIS is to communicate important research and development results in the areas of computer science, software engineering, and information systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信