Shihua Li , Yanjie Zhou , Bing Zhou , Zongmin Wang
{"title":"利用深度强化学习为边缘服务器布局制定基于工作量的自适应决策","authors":"Shihua Li , Yanjie Zhou , Bing Zhou , Zongmin Wang","doi":"10.1016/j.engappai.2024.109662","DOIUrl":null,"url":null,"abstract":"<div><div>Mobile edge computing (MEC) is crucial in applications such as intelligent transportation, innovative healthcare, and smart cities. By deploying servers with computing and storage capabilities at the network edge, MEC enables low-latency services close to end users. However, the configuration of edge servers needs to meet the low-latency requirements and effectively balance the servers’ workloads. This paper proposes an adaptive layout and dynamic optimization method, modeling the edge server layout problem as a Markov decision process. It introduces a workload-based server placement rule that adjusts the locations of edge servers according to the load of base stations, enabling the learning of low-latency and load-balanced server layout strategies. Experimental validation on a real dataset from Shanghai Telecom shows that the proposed algorithm improves average latency performance by about 40% compared to existing technologies, and enhances workload balancing performance by about 17%.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"139 ","pages":"Article 109662"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Workload-based adaptive decision-making for edge server layout with deep reinforcement learning\",\"authors\":\"Shihua Li , Yanjie Zhou , Bing Zhou , Zongmin Wang\",\"doi\":\"10.1016/j.engappai.2024.109662\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Mobile edge computing (MEC) is crucial in applications such as intelligent transportation, innovative healthcare, and smart cities. By deploying servers with computing and storage capabilities at the network edge, MEC enables low-latency services close to end users. However, the configuration of edge servers needs to meet the low-latency requirements and effectively balance the servers’ workloads. This paper proposes an adaptive layout and dynamic optimization method, modeling the edge server layout problem as a Markov decision process. It introduces a workload-based server placement rule that adjusts the locations of edge servers according to the load of base stations, enabling the learning of low-latency and load-balanced server layout strategies. Experimental validation on a real dataset from Shanghai Telecom shows that the proposed algorithm improves average latency performance by about 40% compared to existing technologies, and enhances workload balancing performance by about 17%.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"139 \",\"pages\":\"Article 109662\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-11-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197624018207\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197624018207","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Workload-based adaptive decision-making for edge server layout with deep reinforcement learning
Mobile edge computing (MEC) is crucial in applications such as intelligent transportation, innovative healthcare, and smart cities. By deploying servers with computing and storage capabilities at the network edge, MEC enables low-latency services close to end users. However, the configuration of edge servers needs to meet the low-latency requirements and effectively balance the servers’ workloads. This paper proposes an adaptive layout and dynamic optimization method, modeling the edge server layout problem as a Markov decision process. It introduces a workload-based server placement rule that adjusts the locations of edge servers according to the load of base stations, enabling the learning of low-latency and load-balanced server layout strategies. Experimental validation on a real dataset from Shanghai Telecom shows that the proposed algorithm improves average latency performance by about 40% compared to existing technologies, and enhances workload balancing performance by about 17%.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.