Telemetry-aided cooperative multi-agent online reinforcement learning for DAG task scheduling in computing power networks

IF 3.5 2区 计算机科学 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Yunfeng Duan , Jingchun Li , Hao Sun , Fanqin Zhou , Jiaxing Chen , Tiandong Wu , Wenjing Li , Yuxing Fan
{"title":"Telemetry-aided cooperative multi-agent online reinforcement learning for DAG task scheduling in computing power networks","authors":"Yunfeng Duan ,&nbsp;Jingchun Li ,&nbsp;Hao Sun ,&nbsp;Fanqin Zhou ,&nbsp;Jiaxing Chen ,&nbsp;Tiandong Wu ,&nbsp;Wenjing Li ,&nbsp;Yuxing Fan","doi":"10.1016/j.simpat.2023.102885","DOIUrl":null,"url":null,"abstract":"<div><p><span>As demand for computing power and low latency in intelligence applications grows, the efficient management and coordination of resources in computing power networks become crucial. This paper presents a telemetry-aided multi-agent cooperation framework for DAG task scheduling in computing power networks. Utilizing distributed agents with </span>network telemetry<span>, the framework accurately assesses local network state information, formulates scheduling policies, and assigns tasks to edge servers. An online learning algorithm for DAG task scheduling is also introduced to enhance the cooperation strategy in decision-making, enabling rapid task scheduling and resource allocation decisions. Simulation results demonstrate a minimum 13.5% reduction in total task execution time compared to sub-optimal methods, along with improved node and link load balancing.</span></p></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":null,"pages":null},"PeriodicalIF":3.5000,"publicationDate":"2024-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Simulation Modelling Practice and Theory","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569190X23001624","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

As demand for computing power and low latency in intelligence applications grows, the efficient management and coordination of resources in computing power networks become crucial. This paper presents a telemetry-aided multi-agent cooperation framework for DAG task scheduling in computing power networks. Utilizing distributed agents with network telemetry, the framework accurately assesses local network state information, formulates scheduling policies, and assigns tasks to edge servers. An online learning algorithm for DAG task scheduling is also introduced to enhance the cooperation strategy in decision-making, enabling rapid task scheduling and resource allocation decisions. Simulation results demonstrate a minimum 13.5% reduction in total task execution time compared to sub-optimal methods, along with improved node and link load balancing.

用于计算能力网络中 DAG 任务调度的遥测辅助合作多代理在线强化学习
随着智能应用对计算能力和低延迟的需求日益增长,计算能力网络中资源的高效管理和协调变得至关重要。本文提出了一种遥测辅助的多代理合作框架,用于计算能力网络中的 DAG 任务调度。该框架利用具有网络遥测功能的分布式代理,准确评估本地网络状态信息,制定调度策略,并将任务分配给边缘服务器。该框架还引入了 DAG 任务调度的在线学习算法,以加强决策中的合作策略,从而实现快速的任务调度和资源分配决策。仿真结果表明,与次优方法相比,总任务执行时间至少缩短了 13.5%,节点和链路负载平衡也得到了改善。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Simulation Modelling Practice and Theory
Simulation Modelling Practice and Theory 工程技术-计算机:跨学科应用
CiteScore
9.80
自引率
4.80%
发文量
142
审稿时长
21 days
期刊介绍: The journal Simulation Modelling Practice and Theory provides a forum for original, high-quality papers dealing with any aspect of systems simulation and modelling. The journal aims at being a reference and a powerful tool to all those professionally active and/or interested in the methods and applications of simulation. Submitted papers will be peer reviewed and must significantly contribute to modelling and simulation in general or use modelling and simulation in application areas. Paper submission is solicited on: • theoretical aspects of modelling and simulation including formal modelling, model-checking, random number generators, sensitivity analysis, variance reduction techniques, experimental design, meta-modelling, methods and algorithms for validation and verification, selection and comparison procedures etc.; • methodology and application of modelling and simulation in any area, including computer systems, networks, real-time and embedded systems, mobile and intelligent agents, manufacturing and transportation systems, management, engineering, biomedical engineering, economics, ecology and environment, education, transaction handling, etc.; • simulation languages and environments including those, specific to distributed computing, grid computing, high performance computers or computer networks, etc.; • distributed and real-time simulation, simulation interoperability; • tools for high performance computing simulation, including dedicated architectures and parallel computing.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信