Multi-agent reinforcement learning with graph representation for green edge–cloud computation offloading

IF 4.5 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Yifan Bo , Jinghan Feng , Shou Zhang , Biao Leng
{"title":"Multi-agent reinforcement learning with graph representation for green edge–cloud computation offloading","authors":"Yifan Bo ,&nbsp;Jinghan Feng ,&nbsp;Shou Zhang ,&nbsp;Biao Leng","doi":"10.1016/j.comcom.2025.108176","DOIUrl":null,"url":null,"abstract":"<div><div>Edge–Cloud Computing (ECC) stands as a widely adopted distributed computing architecture that facilitates the offloading of computation-intensive tasks from Internet of Things (IoT) devices to edge servers. The growing emphasis on energy conservation and environmental protection raises the concerns of green edge–cloud computation offloading technology. However, conventional computation offloading methods have difficulties in making real-time offloading decisions and adapting to dynamic environmental changes, such as the communication channels. In response to these challenges, we propose a multi-agent reinforcement learning method with graph representation to address the edge–cloud computing offloading schedule problem. Our approach constructs a multi-agent computation offloading reinforcement learning scenario and utilizes graph neural networks to represent the connectivity features between devices and edge servers. Experimental results demonstrate that our proposed method outperforms other algorithms in reducing system energy consumption and response delay. Furthermore, the time-consuming of our approach is significantly shorter compared to heuristic genetic algorithms, with a reduction of 10–20 times.</div></div>","PeriodicalId":55224,"journal":{"name":"Computer Communications","volume":"239 ","pages":"Article 108176"},"PeriodicalIF":4.5000,"publicationDate":"2025-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Communications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0140366425001331","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Edge–Cloud Computing (ECC) stands as a widely adopted distributed computing architecture that facilitates the offloading of computation-intensive tasks from Internet of Things (IoT) devices to edge servers. The growing emphasis on energy conservation and environmental protection raises the concerns of green edge–cloud computation offloading technology. However, conventional computation offloading methods have difficulties in making real-time offloading decisions and adapting to dynamic environmental changes, such as the communication channels. In response to these challenges, we propose a multi-agent reinforcement learning method with graph representation to address the edge–cloud computing offloading schedule problem. Our approach constructs a multi-agent computation offloading reinforcement learning scenario and utilizes graph neural networks to represent the connectivity features between devices and edge servers. Experimental results demonstrate that our proposed method outperforms other algorithms in reducing system energy consumption and response delay. Furthermore, the time-consuming of our approach is significantly shorter compared to heuristic genetic algorithms, with a reduction of 10–20 times.
基于图表示的多智能体强化学习绿色边缘云计算卸载
边缘云计算(ECC)是一种被广泛采用的分布式计算架构,它有助于将计算密集型任务从物联网(IoT)设备卸载到边缘服务器。随着人们对节能环保的日益重视,绿色边缘云计算卸载技术引起了人们的关注。然而,传统的计算卸载方法在做出实时卸载决策和适应通信信道等动态环境变化方面存在困难。针对这些挑战,我们提出了一种基于图表示的多智能体强化学习方法来解决边缘云计算卸载调度问题。我们的方法构建了一个多智能体计算卸载强化学习场景,并利用图神经网络来表示设备与边缘服务器之间的连接特征。实验结果表明,该方法在降低系统能耗和响应延迟方面优于其他算法。此外,与启发式遗传算法相比,我们的方法的耗时明显缩短,减少了10-20倍。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Communications
Computer Communications 工程技术-电信学
CiteScore
14.10
自引率
5.00%
发文量
397
审稿时长
66 days
期刊介绍: Computer and Communications networks are key infrastructures of the information society with high socio-economic value as they contribute to the correct operations of many critical services (from healthcare to finance and transportation). Internet is the core of today''s computer-communication infrastructures. This has transformed the Internet, from a robust network for data transfer between computers, to a global, content-rich, communication and information system where contents are increasingly generated by the users, and distributed according to human social relations. Next-generation network technologies, architectures and protocols are therefore required to overcome the limitations of the legacy Internet and add new capabilities and services. The future Internet should be ubiquitous, secure, resilient, and closer to human communication paradigms. Computer Communications is a peer-reviewed international journal that publishes high-quality scientific articles (both theory and practice) and survey papers covering all aspects of future computer communication networks (on all layers, except the physical layer), with a special attention to the evolution of the Internet architecture, protocols, services, and applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信