Task offloading and resource allocation in hybrid-powered WPT MEC system: An enhanced deep reinforcement learning method

IF 4.6 2区 计算机科学 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
Ziqi Liu , Gaochao Xu , Bo Liu , Xu Xu , Long Li
{"title":"Task offloading and resource allocation in hybrid-powered WPT MEC system: An enhanced deep reinforcement learning method","authors":"Ziqi Liu ,&nbsp;Gaochao Xu ,&nbsp;Bo Liu ,&nbsp;Xu Xu ,&nbsp;Long Li","doi":"10.1016/j.comnet.2025.111312","DOIUrl":null,"url":null,"abstract":"<div><div>Recently, the integration of mobile edge computing (MEC) and wireless power transfer (WPT) technologies presents a transformative approach to overcoming the energy limitations of wireless devices (WDs), thereby enhancing both the sustainability and operational efficiency of mobile networks. This paper introduces a novel green-prioritized hybrid energy supply system that harnesses both renewable and grid energy, which aims at optimizing energy use and computational power in mobile networks under dynamic conditions. Specifically, we formulate a long-term average grid energy minimization problem (LAGEMP) to reduce grid energy consumption while maintaining robust and efficient network operations. To solve the complex and dynamic LAGEMP, we propose an action space reduction scheme and an enhanced deep deterministic policy gradient (EDDPG) algorithm, which incorporates the cross-entropy method (CEM). These introduced enhanced approaches not only reduce the computational load but also expedite the convergence of network training, thereby optimizing both energy usage and task offloading strategies. Simulation results reveal that the EDDPG algorithm significantly outperforms existing strategies and algorithms, and achieves near-optimal task offloading efficiency with reduced grid energy.</div></div>","PeriodicalId":50637,"journal":{"name":"Computer Networks","volume":"268 ","pages":"Article 111312"},"PeriodicalIF":4.6000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1389128625002804","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

Abstract

Recently, the integration of mobile edge computing (MEC) and wireless power transfer (WPT) technologies presents a transformative approach to overcoming the energy limitations of wireless devices (WDs), thereby enhancing both the sustainability and operational efficiency of mobile networks. This paper introduces a novel green-prioritized hybrid energy supply system that harnesses both renewable and grid energy, which aims at optimizing energy use and computational power in mobile networks under dynamic conditions. Specifically, we formulate a long-term average grid energy minimization problem (LAGEMP) to reduce grid energy consumption while maintaining robust and efficient network operations. To solve the complex and dynamic LAGEMP, we propose an action space reduction scheme and an enhanced deep deterministic policy gradient (EDDPG) algorithm, which incorporates the cross-entropy method (CEM). These introduced enhanced approaches not only reduce the computational load but also expedite the convergence of network training, thereby optimizing both energy usage and task offloading strategies. Simulation results reveal that the EDDPG algorithm significantly outperforms existing strategies and algorithms, and achieves near-optimal task offloading efficiency with reduced grid energy.
混合动力WPT MEC系统的任务卸载和资源分配:一种增强的深度强化学习方法
最近,移动边缘计算(MEC)和无线电力传输(WPT)技术的集成为克服无线设备(wd)的能量限制提供了一种变革性的方法,从而提高了移动网络的可持续性和运营效率。本文介绍了一种利用可再生能源和电网能源的新型绿色优先混合能源供应系统,旨在优化动态条件下移动网络的能源使用和计算能力。具体而言,我们制定了一个长期平均电网能量最小化问题(LAGEMP),以减少电网能量消耗,同时保持稳健和高效的网络运行。为了解决复杂的动态LAGEMP问题,我们提出了一种动作空间约简方案和一种增强的深度确定性策略梯度(EDDPG)算法,该算法结合了交叉熵方法(CEM)。这些改进的方法不仅减少了计算量,而且加快了网络训练的收敛速度,从而优化了能量使用和任务卸载策略。仿真结果表明,EDDPG算法明显优于现有的策略和算法,在降低网格能量的情况下实现了近乎最优的任务卸载效率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Networks
Computer Networks 工程技术-电信学
CiteScore
10.80
自引率
3.60%
发文量
434
审稿时长
8.6 months
期刊介绍: Computer Networks is an international, archival journal providing a publication vehicle for complete coverage of all topics of interest to those involved in the computer communications networking area. The audience includes researchers, managers and operators of networks as well as designers and implementors. The Editorial Board will consider any material for publication that is of interest to those groups.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信