Optimization of resource allocation strategy for high-speed railway based on deep reinforcement learning

IF 2 4区 计算机科学 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC
Xu Gao , Junhui Zhao , Qingmiao Zhang , Haitao Han
{"title":"Optimization of resource allocation strategy for high-speed railway based on deep reinforcement learning","authors":"Xu Gao ,&nbsp;Junhui Zhao ,&nbsp;Qingmiao Zhang ,&nbsp;Haitao Han","doi":"10.1016/j.phycom.2024.102455","DOIUrl":null,"url":null,"abstract":"<div><p>With the accelerated development of high-speed railway (HSR), the contradiction between the surge of user services and the demand for resource has become increasingly prominent. Mobile edge computing (MEC) has emerged to improve performance, reduce communication delay and ease network load. In this paper, we design a multi-user MEC system framework that aims to solve the joint optimization problem of computation offloading and resource allocation in HSR communication scenario with deep reinforcement learning algorithm. The framework dynamically allocates computation resource and network bandwidth through the real-time distance between users and base station (BS) to achieve optimal resource utilization and maximize user experience. To achieve this goal, we use a deep reinforcement learning based dynamic computation offloading and resource allocation (DDCORA) optimization algorithm. The algorithm minimizes the system cost by sharing state information among different users and making collaborative decisions to rationally allocate spectrum resource and computation resource. Simulation results show that DDCORA algorithm can significantly decrease the system cost while enhancing the overall system performance and user experience.</p></div>","PeriodicalId":48707,"journal":{"name":"Physical Communication","volume":"66 ","pages":"Article 102455"},"PeriodicalIF":2.0000,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physical Communication","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1874490724001733","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

With the accelerated development of high-speed railway (HSR), the contradiction between the surge of user services and the demand for resource has become increasingly prominent. Mobile edge computing (MEC) has emerged to improve performance, reduce communication delay and ease network load. In this paper, we design a multi-user MEC system framework that aims to solve the joint optimization problem of computation offloading and resource allocation in HSR communication scenario with deep reinforcement learning algorithm. The framework dynamically allocates computation resource and network bandwidth through the real-time distance between users and base station (BS) to achieve optimal resource utilization and maximize user experience. To achieve this goal, we use a deep reinforcement learning based dynamic computation offloading and resource allocation (DDCORA) optimization algorithm. The algorithm minimizes the system cost by sharing state information among different users and making collaborative decisions to rationally allocate spectrum resource and computation resource. Simulation results show that DDCORA algorithm can significantly decrease the system cost while enhancing the overall system performance and user experience.

基于深度强化学习的高速铁路资源分配策略优化
随着高速铁路(HSR)的加速发展,用户业务量激增与资源需求之间的矛盾日益突出。移动边缘计算(MEC)应运而生,以提高性能、减少通信延迟、减轻网络负荷。本文设计了一个多用户 MEC 系统框架,旨在利用深度强化学习算法解决高铁通信场景中计算卸载和资源分配的联合优化问题。该框架通过用户与基站(BS)之间的实时距离动态分配计算资源和网络带宽,以实现资源的最优化利用和用户体验的最大化。为实现这一目标,我们采用了基于深度强化学习的动态计算卸载和资源分配(DDCORA)优化算法。该算法通过在不同用户之间共享状态信息,并协同决策合理分配频谱资源和计算资源,从而使系统成本最小化。仿真结果表明,DDCORA 算法能显著降低系统成本,同时提高整体系统性能和用户体验。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Physical Communication
Physical Communication ENGINEERING, ELECTRICAL & ELECTRONICTELECO-TELECOMMUNICATIONS
CiteScore
5.00
自引率
9.10%
发文量
212
审稿时长
55 days
期刊介绍: PHYCOM: Physical Communication is an international and archival journal providing complete coverage of all topics of interest to those involved in all aspects of physical layer communications. Theoretical research contributions presenting new techniques, concepts or analyses, applied contributions reporting on experiences and experiments, and tutorials are published. Topics of interest include but are not limited to: Physical layer issues of Wireless Local Area Networks, WiMAX, Wireless Mesh Networks, Sensor and Ad Hoc Networks, PCS Systems; Radio access protocols and algorithms for the physical layer; Spread Spectrum Communications; Channel Modeling; Detection and Estimation; Modulation and Coding; Multiplexing and Carrier Techniques; Broadband Wireless Communications; Wireless Personal Communications; Multi-user Detection; Signal Separation and Interference rejection: Multimedia Communications over Wireless; DSP Applications to Wireless Systems; Experimental and Prototype Results; Multiple Access Techniques; Space-time Processing; Synchronization Techniques; Error Control Techniques; Cryptography; Software Radios; Tracking; Resource Allocation and Inference Management; Multi-rate and Multi-carrier Communications; Cross layer Design and Optimization; Propagation and Channel Characterization; OFDM Systems; MIMO Systems; Ultra-Wideband Communications; Cognitive Radio System Architectures; Platforms and Hardware Implementations for the Support of Cognitive, Radio Systems; Cognitive Radio Resource Management and Dynamic Spectrum Sharing.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信