An Adaptive CMT-SCTP Scheme: A Reinforcement Learning Approach

Deguang Wang, Mingze Wang, Tao Zhang, Shujie Yang, Changqiao Xu
{"title":"An Adaptive CMT-SCTP Scheme: A Reinforcement Learning Approach","authors":"Deguang Wang, Mingze Wang, Tao Zhang, Shujie Yang, Changqiao Xu","doi":"10.33969/j-nana.2021.010404","DOIUrl":null,"url":null,"abstract":"With the continuous increase of end users and types of services, the scale of the network has shown explosive growth, which has brought tremendous pressure and challenges to network data transmission. How to achieve high-quality data transmission has become a core issue. Single-path transmission has been difficult to meet the above requirements. The concurrent multipath transfer extension for stream control transmission protocol (CMT-SCTP), which supports multipath and independent data streams, can solve this problem. However, the current transmission path assessment scheme has too large granularity to make full use of the resources of the transition zone. Most studies ignore the different requirements of different services, a single transmission strategy, and the lack of an intelligent dynamic adjustment mechanism. Therefore, we designed a QCMT(Q-learning based CMT-SCTP) scheduling method. This method considers the multi-dimensional characteristics of the path and the characteristic preferences of different services, periodically evaluates and trains the reinforcement learning model for service adaptation, and makes scheduling decisions dynamically. Experimental results show that dynamic scheduling based on path parameters and service preferences can reduce message delay and improve network throughput.","PeriodicalId":384373,"journal":{"name":"Journal of Networking and Network Applications","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Networking and Network Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.33969/j-nana.2021.010404","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

With the continuous increase of end users and types of services, the scale of the network has shown explosive growth, which has brought tremendous pressure and challenges to network data transmission. How to achieve high-quality data transmission has become a core issue. Single-path transmission has been difficult to meet the above requirements. The concurrent multipath transfer extension for stream control transmission protocol (CMT-SCTP), which supports multipath and independent data streams, can solve this problem. However, the current transmission path assessment scheme has too large granularity to make full use of the resources of the transition zone. Most studies ignore the different requirements of different services, a single transmission strategy, and the lack of an intelligent dynamic adjustment mechanism. Therefore, we designed a QCMT(Q-learning based CMT-SCTP) scheduling method. This method considers the multi-dimensional characteristics of the path and the characteristic preferences of different services, periodically evaluates and trains the reinforcement learning model for service adaptation, and makes scheduling decisions dynamically. Experimental results show that dynamic scheduling based on path parameters and service preferences can reduce message delay and improve network throughput.
自适应CMT-SCTP方案:一种强化学习方法
随着终端用户和业务种类的不断增加,网络规模呈现爆发式增长,这给网络数据传输带来了巨大的压力和挑战。如何实现高质量的数据传输成为一个核心问题。单路传输已难以满足上述要求。流控制传输协议(CMT-SCTP)的并发多径传输扩展支持多径和独立的数据流,可以解决这一问题。然而,目前的传输路径评估方案粒度过大,无法充分利用过渡区资源。大多数研究忽略了不同业务的不同需求,传输策略单一,缺乏智能动态调节机制。因此,我们设计了一种基于q学习的CMT-SCTP调度方法。该方法考虑路径的多维特征和不同服务的特征偏好,定期评估和训练服务适应的强化学习模型,动态地进行调度决策。实验结果表明,基于路径参数和服务偏好的动态调度可以减少消息延迟,提高网络吞吐量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信