{"title":"多访问边缘计算中基于强化学习的细粒度任务自适应卸载方案","authors":"Jie Li , Ge Chen , Kansong Chen","doi":"10.1016/j.simpat.2025.103139","DOIUrl":null,"url":null,"abstract":"<div><div>In the context of multi-access edge computing, the constraints on device resources and energy pose a challenge in meeting the requirements of delay-sensitive and high-resource demand tasks. In order to address this issue, this paper puts forth an adaptive offloading decision based on fine-grained task sequencing (AOD-FTS). To enhance task execution efficiency and resource utilization, we design scheduling optimization for subtasks algorithm within the fine-grained task model to optimize the execution order of subtasks and improve subtask parallelism. Additionally, to reduce task delay and energy consumption, we propose an adaptive multi-objective reinforcement learning offloading algorithm based on ordered subtasks, formulated through multi-objective Markov decision processes. The scheme dynamically adjusts optimization preferences according to environmental changes and task completion states to make offloading decisions. Simulation results demonstrate that compared with two benchmark algorithms, the proposed AOD-FTS scheme achieves: (1) higher task completion rates, (2) improved resource utilization efficiency, (3) 81.66 % and 51.53 % reductions in delay respectively, and (4) 39.72 % and 71.36 % reductions in energy consumption respectively.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"143 ","pages":"Article 103139"},"PeriodicalIF":3.5000,"publicationDate":"2025-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adaptive offloading scheme of fine-grained tasks based on reinforcement learning in multi-access edge computing\",\"authors\":\"Jie Li , Ge Chen , Kansong Chen\",\"doi\":\"10.1016/j.simpat.2025.103139\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In the context of multi-access edge computing, the constraints on device resources and energy pose a challenge in meeting the requirements of delay-sensitive and high-resource demand tasks. In order to address this issue, this paper puts forth an adaptive offloading decision based on fine-grained task sequencing (AOD-FTS). To enhance task execution efficiency and resource utilization, we design scheduling optimization for subtasks algorithm within the fine-grained task model to optimize the execution order of subtasks and improve subtask parallelism. Additionally, to reduce task delay and energy consumption, we propose an adaptive multi-objective reinforcement learning offloading algorithm based on ordered subtasks, formulated through multi-objective Markov decision processes. The scheme dynamically adjusts optimization preferences according to environmental changes and task completion states to make offloading decisions. Simulation results demonstrate that compared with two benchmark algorithms, the proposed AOD-FTS scheme achieves: (1) higher task completion rates, (2) improved resource utilization efficiency, (3) 81.66 % and 51.53 % reductions in delay respectively, and (4) 39.72 % and 71.36 % reductions in energy consumption respectively.</div></div>\",\"PeriodicalId\":49518,\"journal\":{\"name\":\"Simulation Modelling Practice and Theory\",\"volume\":\"143 \",\"pages\":\"Article 103139\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2025-05-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Simulation Modelling Practice and Theory\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569190X25000747\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Simulation Modelling Practice and Theory","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569190X25000747","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Adaptive offloading scheme of fine-grained tasks based on reinforcement learning in multi-access edge computing
In the context of multi-access edge computing, the constraints on device resources and energy pose a challenge in meeting the requirements of delay-sensitive and high-resource demand tasks. In order to address this issue, this paper puts forth an adaptive offloading decision based on fine-grained task sequencing (AOD-FTS). To enhance task execution efficiency and resource utilization, we design scheduling optimization for subtasks algorithm within the fine-grained task model to optimize the execution order of subtasks and improve subtask parallelism. Additionally, to reduce task delay and energy consumption, we propose an adaptive multi-objective reinforcement learning offloading algorithm based on ordered subtasks, formulated through multi-objective Markov decision processes. The scheme dynamically adjusts optimization preferences according to environmental changes and task completion states to make offloading decisions. Simulation results demonstrate that compared with two benchmark algorithms, the proposed AOD-FTS scheme achieves: (1) higher task completion rates, (2) improved resource utilization efficiency, (3) 81.66 % and 51.53 % reductions in delay respectively, and (4) 39.72 % and 71.36 % reductions in energy consumption respectively.
期刊介绍:
The journal Simulation Modelling Practice and Theory provides a forum for original, high-quality papers dealing with any aspect of systems simulation and modelling.
The journal aims at being a reference and a powerful tool to all those professionally active and/or interested in the methods and applications of simulation. Submitted papers will be peer reviewed and must significantly contribute to modelling and simulation in general or use modelling and simulation in application areas.
Paper submission is solicited on:
• theoretical aspects of modelling and simulation including formal modelling, model-checking, random number generators, sensitivity analysis, variance reduction techniques, experimental design, meta-modelling, methods and algorithms for validation and verification, selection and comparison procedures etc.;
• methodology and application of modelling and simulation in any area, including computer systems, networks, real-time and embedded systems, mobile and intelligent agents, manufacturing and transportation systems, management, engineering, biomedical engineering, economics, ecology and environment, education, transaction handling, etc.;
• simulation languages and environments including those, specific to distributed computing, grid computing, high performance computers or computer networks, etc.;
• distributed and real-time simulation, simulation interoperability;
• tools for high performance computing simulation, including dedicated architectures and parallel computing.