{"title":"公共边缘平台上分层联邦学习的边缘资源自动缩放","authors":"Mingliao Zhao, Kongyange Zhao, Zhi Zhou, Xu Chen","doi":"10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00123","DOIUrl":null,"url":null,"abstract":"Federated learning promises to empower ubiquitous end devices to collaboratively learn a shared model in a privacy-preserving manner. To reduce the enormous and expensive wide-area-network (WAN) traffic incurred by the traditional two-tiered cloud-device federated learning, hierarchical federated learning over cloud-edge-device has been proposed recently. With hierarchical federated learning, edge servers are leveraged as intermediaries to perform local model aggregations to reduce the model updates aggregated by the centralized cloud. Considering the emerging public edge platforms such as Aliyun Edge Node Service that rent edge servers to users in an on-demand manner, we present AutoEdge, an edge server autoscaling framework for hierarchical federated learning. The goal of AutoEdge is to autoscale edge servers against dynamical device participants in a cost-efficient manner. Achieving this goal is challenging since the underlying long-term optimization problem is NP-hard involves the future system information. To attack these challenges, AutoEdge first applies regularization technique to decompose the long-term problem into a set of solvable fractional subproblems. Then, adopting a randomized dependent rounding scheme, AutoEdge further rounds the fractional solutions to a near-optimal and feasible integral solution. AutoEdge achieves outstanding performance guarantee, as verified by both rigorous theoretical analysis and extensive trace-driven simulations.","PeriodicalId":43791,"journal":{"name":"Scalable Computing-Practice and Experience","volume":"70 1","pages":"806-814"},"PeriodicalIF":0.9000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Edge Resource Autoscaling for Hierarchical Federated Learning Over Public Edge Platforms\",\"authors\":\"Mingliao Zhao, Kongyange Zhao, Zhi Zhou, Xu Chen\",\"doi\":\"10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00123\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Federated learning promises to empower ubiquitous end devices to collaboratively learn a shared model in a privacy-preserving manner. To reduce the enormous and expensive wide-area-network (WAN) traffic incurred by the traditional two-tiered cloud-device federated learning, hierarchical federated learning over cloud-edge-device has been proposed recently. With hierarchical federated learning, edge servers are leveraged as intermediaries to perform local model aggregations to reduce the model updates aggregated by the centralized cloud. Considering the emerging public edge platforms such as Aliyun Edge Node Service that rent edge servers to users in an on-demand manner, we present AutoEdge, an edge server autoscaling framework for hierarchical federated learning. The goal of AutoEdge is to autoscale edge servers against dynamical device participants in a cost-efficient manner. Achieving this goal is challenging since the underlying long-term optimization problem is NP-hard involves the future system information. To attack these challenges, AutoEdge first applies regularization technique to decompose the long-term problem into a set of solvable fractional subproblems. Then, adopting a randomized dependent rounding scheme, AutoEdge further rounds the fractional solutions to a near-optimal and feasible integral solution. AutoEdge achieves outstanding performance guarantee, as verified by both rigorous theoretical analysis and extensive trace-driven simulations.\",\"PeriodicalId\":43791,\"journal\":{\"name\":\"Scalable Computing-Practice and Experience\",\"volume\":\"70 1\",\"pages\":\"806-814\"},\"PeriodicalIF\":0.9000,\"publicationDate\":\"2022-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Scalable Computing-Practice and Experience\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00123\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, SOFTWARE ENGINEERING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Scalable Computing-Practice and Experience","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00123","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
Edge Resource Autoscaling for Hierarchical Federated Learning Over Public Edge Platforms
Federated learning promises to empower ubiquitous end devices to collaboratively learn a shared model in a privacy-preserving manner. To reduce the enormous and expensive wide-area-network (WAN) traffic incurred by the traditional two-tiered cloud-device federated learning, hierarchical federated learning over cloud-edge-device has been proposed recently. With hierarchical federated learning, edge servers are leveraged as intermediaries to perform local model aggregations to reduce the model updates aggregated by the centralized cloud. Considering the emerging public edge platforms such as Aliyun Edge Node Service that rent edge servers to users in an on-demand manner, we present AutoEdge, an edge server autoscaling framework for hierarchical federated learning. The goal of AutoEdge is to autoscale edge servers against dynamical device participants in a cost-efficient manner. Achieving this goal is challenging since the underlying long-term optimization problem is NP-hard involves the future system information. To attack these challenges, AutoEdge first applies regularization technique to decompose the long-term problem into a set of solvable fractional subproblems. Then, adopting a randomized dependent rounding scheme, AutoEdge further rounds the fractional solutions to a near-optimal and feasible integral solution. AutoEdge achieves outstanding performance guarantee, as verified by both rigorous theoretical analysis and extensive trace-driven simulations.
期刊介绍:
The area of scalable computing has matured and reached a point where new issues and trends require a professional forum. SCPE will provide this avenue by publishing original refereed papers that address the present as well as the future of parallel and distributed computing. The journal will focus on algorithm development, implementation and execution on real-world parallel architectures, and application of parallel and distributed computing to the solution of real-life problems.