一种面向无线移动边缘计算网络的图强化学习在线计算任务卸载和延迟最小化框架

IF 2.1 3区 心理学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Akshat Agrawal , Aayush Agrawal , Nilesh Kumar Verma , Arepalli Peda Gopi , K. Jairam Naik
{"title":"一种面向无线移动边缘计算网络的图强化学习在线计算任务卸载和延迟最小化框架","authors":"Akshat Agrawal ,&nbsp;Aayush Agrawal ,&nbsp;Nilesh Kumar Verma ,&nbsp;Arepalli Peda Gopi ,&nbsp;K. Jairam Naik","doi":"10.1016/j.cogsys.2025.101355","DOIUrl":null,"url":null,"abstract":"<div><div>Data processing capability of lower power networks can be improved by Mobile Edge Computing (MEC) extending to the wireless sensor networks and IoT. Creating a replication of MEC network with an offloading policy where a choice is made in the Wireless devices (WDs) for each computation task is the focus of this study. Deciding whether the task execution proceeds locally in the same environment or can be handed over to a remote MEC server, an optimized algorithm is needed which adopts task offloading decisions and wireless resource allocation in real time. But adopting this is a challenging solution to the real time fast combinatorial optimization problems, and impossible with the available traditional approaches. As a solution, heuristic algorithms encompassing Deep reinforcement learning (DRL) are emerging; however, it doesn’t make fair use of connection data like device-to-device interaction in MEC network. Moreover, heuristic algorithms rely on precise mathematical models for MEC systems which brought a new theory to the stage. This study revolves around this emerging technique relying on Graph neural networks (GNNs) learns from graph data while forwarding messages in the network. Utilizing GNN benefits, a Graph reinforcement learning-based online offloading framework (GROO) is proposed in this research, where the offloading policy is visualized as a graph state migration and MEC as an acyclic graph. The GROO achieves the lowest weighted task response latency (0.96 s) as compared to the existing DRL method (1.32 s) whereas on unseen circumstances and complex network topologies, GROO achieved lowest average latency up to 25 %.</div></div>","PeriodicalId":55242,"journal":{"name":"Cognitive Systems Research","volume":"91 ","pages":"Article 101355"},"PeriodicalIF":2.1000,"publicationDate":"2025-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A graph reinforcement LearningPowered Online-Computational task offloading and latency minimization framework for wireless mobile edge computing networks\",\"authors\":\"Akshat Agrawal ,&nbsp;Aayush Agrawal ,&nbsp;Nilesh Kumar Verma ,&nbsp;Arepalli Peda Gopi ,&nbsp;K. Jairam Naik\",\"doi\":\"10.1016/j.cogsys.2025.101355\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Data processing capability of lower power networks can be improved by Mobile Edge Computing (MEC) extending to the wireless sensor networks and IoT. Creating a replication of MEC network with an offloading policy where a choice is made in the Wireless devices (WDs) for each computation task is the focus of this study. Deciding whether the task execution proceeds locally in the same environment or can be handed over to a remote MEC server, an optimized algorithm is needed which adopts task offloading decisions and wireless resource allocation in real time. But adopting this is a challenging solution to the real time fast combinatorial optimization problems, and impossible with the available traditional approaches. As a solution, heuristic algorithms encompassing Deep reinforcement learning (DRL) are emerging; however, it doesn’t make fair use of connection data like device-to-device interaction in MEC network. Moreover, heuristic algorithms rely on precise mathematical models for MEC systems which brought a new theory to the stage. This study revolves around this emerging technique relying on Graph neural networks (GNNs) learns from graph data while forwarding messages in the network. Utilizing GNN benefits, a Graph reinforcement learning-based online offloading framework (GROO) is proposed in this research, where the offloading policy is visualized as a graph state migration and MEC as an acyclic graph. The GROO achieves the lowest weighted task response latency (0.96 s) as compared to the existing DRL method (1.32 s) whereas on unseen circumstances and complex network topologies, GROO achieved lowest average latency up to 25 %.</div></div>\",\"PeriodicalId\":55242,\"journal\":{\"name\":\"Cognitive Systems Research\",\"volume\":\"91 \",\"pages\":\"Article 101355\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2025-03-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cognitive Systems Research\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S138904172500035X\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cognitive Systems Research","FirstCategoryId":"102","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S138904172500035X","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

移动边缘计算(MEC)扩展到无线传感器网络和物联网,可以提高低功耗网络的数据处理能力。本研究的重点是创建一个具有卸载策略的MEC网络的复制,其中每个计算任务在无线设备(wd)中进行选择。任务执行是在同一环境下本地进行,还是可以移交给远程MEC服务器,需要一种采用任务卸载决策和实时无线资源分配的优化算法。但是,采用这种方法来解决实时快速组合优化问题是一种具有挑战性的解决方案,用现有的传统方法是不可能的。作为解决方案,包含深度强化学习(DRL)的启发式算法正在出现;然而,它没有合理地利用连接数据,如MEC网络中的设备对设备交互。此外,启发式算法依赖于MEC系统的精确数学模型,这为MEC系统提供了一个新的理论。本研究围绕这一新兴技术展开,该技术依赖于图神经网络(gnn)在网络中转发消息时从图数据中学习。利用GNN的优势,提出了一种基于图强化学习的在线卸载框架(GROO),将卸载策略可视化为图状态迁移,将MEC可视化为无环图。与现有的DRL方法(1.32秒)相比,GROO实现了最低的加权任务响应延迟(0.96秒),而在不可见的环境和复杂的网络拓扑中,GROO实现了最低的平均延迟,最高可达25%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A graph reinforcement LearningPowered Online-Computational task offloading and latency minimization framework for wireless mobile edge computing networks
Data processing capability of lower power networks can be improved by Mobile Edge Computing (MEC) extending to the wireless sensor networks and IoT. Creating a replication of MEC network with an offloading policy where a choice is made in the Wireless devices (WDs) for each computation task is the focus of this study. Deciding whether the task execution proceeds locally in the same environment or can be handed over to a remote MEC server, an optimized algorithm is needed which adopts task offloading decisions and wireless resource allocation in real time. But adopting this is a challenging solution to the real time fast combinatorial optimization problems, and impossible with the available traditional approaches. As a solution, heuristic algorithms encompassing Deep reinforcement learning (DRL) are emerging; however, it doesn’t make fair use of connection data like device-to-device interaction in MEC network. Moreover, heuristic algorithms rely on precise mathematical models for MEC systems which brought a new theory to the stage. This study revolves around this emerging technique relying on Graph neural networks (GNNs) learns from graph data while forwarding messages in the network. Utilizing GNN benefits, a Graph reinforcement learning-based online offloading framework (GROO) is proposed in this research, where the offloading policy is visualized as a graph state migration and MEC as an acyclic graph. The GROO achieves the lowest weighted task response latency (0.96 s) as compared to the existing DRL method (1.32 s) whereas on unseen circumstances and complex network topologies, GROO achieved lowest average latency up to 25 %.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Cognitive Systems Research
Cognitive Systems Research 工程技术-计算机:人工智能
CiteScore
9.40
自引率
5.10%
发文量
40
审稿时长
>12 weeks
期刊介绍: Cognitive Systems Research is dedicated to the study of human-level cognition. As such, it welcomes papers which advance the understanding, design and applications of cognitive and intelligent systems, both natural and artificial. The journal brings together a broad community studying cognition in its many facets in vivo and in silico, across the developmental spectrum, focusing on individual capacities or on entire architectures. It aims to foster debate and integrate ideas, concepts, constructs, theories, models and techniques from across different disciplines and different perspectives on human-level cognition. The scope of interest includes the study of cognitive capacities and architectures - both brain-inspired and non-brain-inspired - and the application of cognitive systems to real-world problems as far as it offers insights relevant for the understanding of cognition. Cognitive Systems Research therefore welcomes mature and cutting-edge research approaching cognition from a systems-oriented perspective, both theoretical and empirically-informed, in the form of original manuscripts, short communications, opinion articles, systematic reviews, and topical survey articles from the fields of Cognitive Science (including Philosophy of Cognitive Science), Artificial Intelligence/Computer Science, Cognitive Robotics, Developmental Science, Psychology, and Neuroscience and Neuromorphic Engineering. Empirical studies will be considered if they are supplemented by theoretical analyses and contributions to theory development and/or computational modelling studies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信