A Comprehensive Reinforcement Learning Framework for Priority-Aware Data Center Scheduling Optimization and QOS-Defined Buffer Management

IF 1.5 4区 计算机科学 Q3 COMPUTER SCIENCE, SOFTWARE ENGINEERING
Vinu Josephraj, Wilfred Franklin Sundara Raj
{"title":"A Comprehensive Reinforcement Learning Framework for Priority-Aware Data Center Scheduling Optimization and QOS-Defined Buffer Management","authors":"Vinu Josephraj,&nbsp;Wilfred Franklin Sundara Raj","doi":"10.1002/cpe.70028","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>A network architecture's fundamental components include buffering designs and policies for their effective administration. Strong incentives exist to test and implement new regulations, but there are few opportunities to alter much more than minor details. We describe Open Queue, a new specification language that enables the expression of management rules and virtual buffering architectures that represent a broad range of economic models. Open Queue provides various comparators and basic functions that make it easy for users to create whole buffering structures and policies. It provides examples of Open Queue buffer management strategies and provides empirical evidence of how they affect performance in different scenarios. Through all of these efforts, minimizing network usage, avoiding network congestion, which ensures QoS (Quality of Service), and making the most use of the current route is regarded as the main problems. Common traffic engineering methods like Equal Cost Multipath (ECMP) don't address the state of the network at the moment or offer a mouse flow solution. The proposed solution to this issue is the implementation of a Deep Reinforcement Learning (DRL) based Priority-Aware Data Center Scheduling Algorithm (PADCS), which leverages AHP-TOPSIS to update previous experience using prioritized experiences replay, monitor workload categorization, and receive real-time environmental feedback. Finally, the suggested algorithm determines the optimal route through the network for every flow depending on the kind of current flows in order to increase customer happiness and improve QoS. The evaluation findings show that, under various traffic scenarios, the DRL-PADCS algorithm lowers average throughput and normalized total throughput, link usage, average round-trip time, and packet loss rate in comparison to ECMP.</p>\n </div>","PeriodicalId":55214,"journal":{"name":"Concurrency and Computation-Practice & Experience","volume":"37 4-5","pages":""},"PeriodicalIF":1.5000,"publicationDate":"2025-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Concurrency and Computation-Practice & Experience","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cpe.70028","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
引用次数: 0

Abstract

A network architecture's fundamental components include buffering designs and policies for their effective administration. Strong incentives exist to test and implement new regulations, but there are few opportunities to alter much more than minor details. We describe Open Queue, a new specification language that enables the expression of management rules and virtual buffering architectures that represent a broad range of economic models. Open Queue provides various comparators and basic functions that make it easy for users to create whole buffering structures and policies. It provides examples of Open Queue buffer management strategies and provides empirical evidence of how they affect performance in different scenarios. Through all of these efforts, minimizing network usage, avoiding network congestion, which ensures QoS (Quality of Service), and making the most use of the current route is regarded as the main problems. Common traffic engineering methods like Equal Cost Multipath (ECMP) don't address the state of the network at the moment or offer a mouse flow solution. The proposed solution to this issue is the implementation of a Deep Reinforcement Learning (DRL) based Priority-Aware Data Center Scheduling Algorithm (PADCS), which leverages AHP-TOPSIS to update previous experience using prioritized experiences replay, monitor workload categorization, and receive real-time environmental feedback. Finally, the suggested algorithm determines the optimal route through the network for every flow depending on the kind of current flows in order to increase customer happiness and improve QoS. The evaluation findings show that, under various traffic scenarios, the DRL-PADCS algorithm lowers average throughput and normalized total throughput, link usage, average round-trip time, and packet loss rate in comparison to ECMP.

优先级感知数据中心调度优化和qos定义缓冲区管理的综合强化学习框架
网络体系结构的基本组件包括缓冲设计和有效管理策略。测试和实施新法规的动机非常强烈,但几乎没有机会改变更多的细节。我们将描述Open Queue,这是一种新的规范语言,它支持管理规则和虚拟缓冲架构的表达,这些架构代表了广泛的经济模型。Open Queue提供了各种比较器和基本函数,使用户可以轻松地创建整个缓冲结构和策略。它提供了Open Queue缓冲区管理策略的示例,并提供了它们在不同场景中如何影响性能的经验证据。通过这些努力,最小化网络使用量,避免网络拥塞,保证QoS (Quality of Service),最大限度地利用当前路由是主要问题。常用的流量工程方法,如等成本多路径(ECMP),不能处理当前的网络状态,也不能提供一个鼠标流解决方案。针对该问题提出的解决方案是实施基于深度强化学习(DRL)的优先级感知数据中心调度算法(PADCS),该算法利用AHP-TOPSIS使用优先级经验重播来更新先前的经验,监控工作负载分类,并接收实时环境反馈。最后,该算法根据当前流的类型确定每个流通过网络的最优路径,以增加客户满意度并改善QoS。评估结果表明,在各种流量场景下,与ECMP相比,DRL-PADCS算法降低了平均吞吐量和标准化总吞吐量、链路利用率、平均往返时间和丢包率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Concurrency and Computation-Practice & Experience
Concurrency and Computation-Practice & Experience 工程技术-计算机:理论方法
CiteScore
5.00
自引率
10.00%
发文量
664
审稿时长
9.6 months
期刊介绍: Concurrency and Computation: Practice and Experience (CCPE) publishes high-quality, original research papers, and authoritative research review papers, in the overlapping fields of: Parallel and distributed computing; High-performance computing; Computational and data science; Artificial intelligence and machine learning; Big data applications, algorithms, and systems; Network science; Ontologies and semantics; Security and privacy; Cloud/edge/fog computing; Green computing; and Quantum computing.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信