{"title":"基于深度强化学习的mec支持物联网网络任务卸载和资源分配","authors":"Ze Wei, Rongxi He, Yunuo Li","doi":"10.1109/ICCCWorkshops57813.2023.10233832","DOIUrl":null,"url":null,"abstract":"Mobile Edge Computing (MEC) is emerging as a paradigm for meeting the ever-increasing demands of Internet of Things (IoT) applications in real time. Furthermore, the incorporation of renewable energy harvesting capabilities into base stations or IoT devices has the potential to reduce grid energy consumption. However, it is critical to make an efficient decision for task offloading and resource allocation in order to fully utilize system potential and reduce carbon emissions. In this paper, we propose a carbon-aware MEC framework for a hybrid renewable and grid-energy MEC system. In particular, we aim to optimize the system’s task queue length and carbon emissions in an unpredictable environment with stochastic tasks and renewable energy arrivals. We first formulate the joint task offloading and resource allocation problem by optimizing the total system cost (including task queue length and carbon emissions) and then propose a DDPG-based joint optimization strategy, eventually obtaining an effective resolution through continuous action space learning in the changing environment. Numerical results confirm that our proposal can yield efficient offloading and reduce carbon emissions for the proposed MEC network.","PeriodicalId":201450,"journal":{"name":"2023 IEEE/CIC International Conference on Communications in China (ICCC Workshops)","volume":"300 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning Based Task Offloading and Resource Allocation for MEC-Enabled IoT Networks\",\"authors\":\"Ze Wei, Rongxi He, Yunuo Li\",\"doi\":\"10.1109/ICCCWorkshops57813.2023.10233832\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Mobile Edge Computing (MEC) is emerging as a paradigm for meeting the ever-increasing demands of Internet of Things (IoT) applications in real time. Furthermore, the incorporation of renewable energy harvesting capabilities into base stations or IoT devices has the potential to reduce grid energy consumption. However, it is critical to make an efficient decision for task offloading and resource allocation in order to fully utilize system potential and reduce carbon emissions. In this paper, we propose a carbon-aware MEC framework for a hybrid renewable and grid-energy MEC system. In particular, we aim to optimize the system’s task queue length and carbon emissions in an unpredictable environment with stochastic tasks and renewable energy arrivals. We first formulate the joint task offloading and resource allocation problem by optimizing the total system cost (including task queue length and carbon emissions) and then propose a DDPG-based joint optimization strategy, eventually obtaining an effective resolution through continuous action space learning in the changing environment. Numerical results confirm that our proposal can yield efficient offloading and reduce carbon emissions for the proposed MEC network.\",\"PeriodicalId\":201450,\"journal\":{\"name\":\"2023 IEEE/CIC International Conference on Communications in China (ICCC Workshops)\",\"volume\":\"300 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-08-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE/CIC International Conference on Communications in China (ICCC Workshops)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCCWorkshops57813.2023.10233832\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE/CIC International Conference on Communications in China (ICCC Workshops)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCCWorkshops57813.2023.10233832","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Deep Reinforcement Learning Based Task Offloading and Resource Allocation for MEC-Enabled IoT Networks
Mobile Edge Computing (MEC) is emerging as a paradigm for meeting the ever-increasing demands of Internet of Things (IoT) applications in real time. Furthermore, the incorporation of renewable energy harvesting capabilities into base stations or IoT devices has the potential to reduce grid energy consumption. However, it is critical to make an efficient decision for task offloading and resource allocation in order to fully utilize system potential and reduce carbon emissions. In this paper, we propose a carbon-aware MEC framework for a hybrid renewable and grid-energy MEC system. In particular, we aim to optimize the system’s task queue length and carbon emissions in an unpredictable environment with stochastic tasks and renewable energy arrivals. We first formulate the joint task offloading and resource allocation problem by optimizing the total system cost (including task queue length and carbon emissions) and then propose a DDPG-based joint optimization strategy, eventually obtaining an effective resolution through continuous action space learning in the changing environment. Numerical results confirm that our proposal can yield efficient offloading and reduce carbon emissions for the proposed MEC network.