{"title":"混合动力WPT MEC系统的任务卸载和资源分配:一种增强的深度强化学习方法","authors":"Ziqi Liu , Gaochao Xu , Bo Liu , Xu Xu , Long Li","doi":"10.1016/j.comnet.2025.111312","DOIUrl":null,"url":null,"abstract":"<div><div>Recently, the integration of mobile edge computing (MEC) and wireless power transfer (WPT) technologies presents a transformative approach to overcoming the energy limitations of wireless devices (WDs), thereby enhancing both the sustainability and operational efficiency of mobile networks. This paper introduces a novel green-prioritized hybrid energy supply system that harnesses both renewable and grid energy, which aims at optimizing energy use and computational power in mobile networks under dynamic conditions. Specifically, we formulate a long-term average grid energy minimization problem (LAGEMP) to reduce grid energy consumption while maintaining robust and efficient network operations. To solve the complex and dynamic LAGEMP, we propose an action space reduction scheme and an enhanced deep deterministic policy gradient (EDDPG) algorithm, which incorporates the cross-entropy method (CEM). These introduced enhanced approaches not only reduce the computational load but also expedite the convergence of network training, thereby optimizing both energy usage and task offloading strategies. Simulation results reveal that the EDDPG algorithm significantly outperforms existing strategies and algorithms, and achieves near-optimal task offloading efficiency with reduced grid energy.</div></div>","PeriodicalId":50637,"journal":{"name":"Computer Networks","volume":"268 ","pages":"Article 111312"},"PeriodicalIF":4.6000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Task offloading and resource allocation in hybrid-powered WPT MEC system: An enhanced deep reinforcement learning method\",\"authors\":\"Ziqi Liu , Gaochao Xu , Bo Liu , Xu Xu , Long Li\",\"doi\":\"10.1016/j.comnet.2025.111312\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Recently, the integration of mobile edge computing (MEC) and wireless power transfer (WPT) technologies presents a transformative approach to overcoming the energy limitations of wireless devices (WDs), thereby enhancing both the sustainability and operational efficiency of mobile networks. This paper introduces a novel green-prioritized hybrid energy supply system that harnesses both renewable and grid energy, which aims at optimizing energy use and computational power in mobile networks under dynamic conditions. Specifically, we formulate a long-term average grid energy minimization problem (LAGEMP) to reduce grid energy consumption while maintaining robust and efficient network operations. To solve the complex and dynamic LAGEMP, we propose an action space reduction scheme and an enhanced deep deterministic policy gradient (EDDPG) algorithm, which incorporates the cross-entropy method (CEM). These introduced enhanced approaches not only reduce the computational load but also expedite the convergence of network training, thereby optimizing both energy usage and task offloading strategies. Simulation results reveal that the EDDPG algorithm significantly outperforms existing strategies and algorithms, and achieves near-optimal task offloading efficiency with reduced grid energy.</div></div>\",\"PeriodicalId\":50637,\"journal\":{\"name\":\"Computer Networks\",\"volume\":\"268 \",\"pages\":\"Article 111312\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2025-05-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Networks\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1389128625002804\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1389128625002804","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
Task offloading and resource allocation in hybrid-powered WPT MEC system: An enhanced deep reinforcement learning method
Recently, the integration of mobile edge computing (MEC) and wireless power transfer (WPT) technologies presents a transformative approach to overcoming the energy limitations of wireless devices (WDs), thereby enhancing both the sustainability and operational efficiency of mobile networks. This paper introduces a novel green-prioritized hybrid energy supply system that harnesses both renewable and grid energy, which aims at optimizing energy use and computational power in mobile networks under dynamic conditions. Specifically, we formulate a long-term average grid energy minimization problem (LAGEMP) to reduce grid energy consumption while maintaining robust and efficient network operations. To solve the complex and dynamic LAGEMP, we propose an action space reduction scheme and an enhanced deep deterministic policy gradient (EDDPG) algorithm, which incorporates the cross-entropy method (CEM). These introduced enhanced approaches not only reduce the computational load but also expedite the convergence of network training, thereby optimizing both energy usage and task offloading strategies. Simulation results reveal that the EDDPG algorithm significantly outperforms existing strategies and algorithms, and achieves near-optimal task offloading efficiency with reduced grid energy.
期刊介绍:
Computer Networks is an international, archival journal providing a publication vehicle for complete coverage of all topics of interest to those involved in the computer communications networking area. The audience includes researchers, managers and operators of networks as well as designers and implementors. The Editorial Board will consider any material for publication that is of interest to those groups.