Yunfeng Duan , Jingchun Li , Hao Sun , Fanqin Zhou , Jiaxing Chen , Tiandong Wu , Wenjing Li , Yuxing Fan
{"title":"Telemetry-aided cooperative multi-agent online reinforcement learning for DAG task scheduling in computing power networks","authors":"Yunfeng Duan , Jingchun Li , Hao Sun , Fanqin Zhou , Jiaxing Chen , Tiandong Wu , Wenjing Li , Yuxing Fan","doi":"10.1016/j.simpat.2023.102885","DOIUrl":null,"url":null,"abstract":"<div><p><span>As demand for computing power and low latency in intelligence applications grows, the efficient management and coordination of resources in computing power networks become crucial. This paper presents a telemetry-aided multi-agent cooperation framework for DAG task scheduling in computing power networks. Utilizing distributed agents with </span>network telemetry<span>, the framework accurately assesses local network state information, formulates scheduling policies, and assigns tasks to edge servers. An online learning algorithm for DAG task scheduling is also introduced to enhance the cooperation strategy in decision-making, enabling rapid task scheduling and resource allocation decisions. Simulation results demonstrate a minimum 13.5% reduction in total task execution time compared to sub-optimal methods, along with improved node and link load balancing.</span></p></div>","PeriodicalId":3,"journal":{"name":"ACS Applied Electronic Materials","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Electronic Materials","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569190X23001624","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
As demand for computing power and low latency in intelligence applications grows, the efficient management and coordination of resources in computing power networks become crucial. This paper presents a telemetry-aided multi-agent cooperation framework for DAG task scheduling in computing power networks. Utilizing distributed agents with network telemetry, the framework accurately assesses local network state information, formulates scheduling policies, and assigns tasks to edge servers. An online learning algorithm for DAG task scheduling is also introduced to enhance the cooperation strategy in decision-making, enabling rapid task scheduling and resource allocation decisions. Simulation results demonstrate a minimum 13.5% reduction in total task execution time compared to sub-optimal methods, along with improved node and link load balancing.
随着智能应用对计算能力和低延迟的需求日益增长,计算能力网络中资源的高效管理和协调变得至关重要。本文提出了一种遥测辅助的多代理合作框架,用于计算能力网络中的 DAG 任务调度。该框架利用具有网络遥测功能的分布式代理,准确评估本地网络状态信息,制定调度策略,并将任务分配给边缘服务器。该框架还引入了 DAG 任务调度的在线学习算法,以加强决策中的合作策略,从而实现快速的任务调度和资源分配决策。仿真结果表明,与次优方法相比,总任务执行时间至少缩短了 13.5%,节点和链路负载平衡也得到了改善。