Review on Reinforcement Learning-based approaches for Service Function Chain deployment in 5G networks

Nour Elimane Elbey, Soheyb Ayad, Bilal Benhaya
{"title":"Review on Reinforcement Learning-based approaches for Service Function Chain deployment in 5G networks","authors":"Nour Elimane Elbey, Soheyb Ayad, Bilal Benhaya","doi":"10.1109/NTIC55069.2022.10100562","DOIUrl":null,"url":null,"abstract":"5G networks are capable of supporting a wide range of applications with different requirements, which brings several use cases for mobile networks and increases user demands. The advancement of 5G is dependent on new technologies such as Software Defined Networks (SDN), Network Function Virtualization (NFV), and Service Function Chain (SFC). SDN enables the separation of control and data planes. NFV decouples network functions from hardware using virtualization. SFC is a popular service paradigm that has been proposed to derive maximum benefits from both NFV and SDN in 5G networks. The infrastructure of 5G networks brings a change in the network management approaches for deploying network services by allocating resources and determining optimal forwarding paths. The existing deployment methods have some shortcomings that require complete knowledge of the system. For that, Reinforcement Learning (RL) and Deep Reinforcement Learning (DRL), which have demonstrated success in solving complex control and decision-making problems by allowing network entities to learn, build knowledge, and make optimal decisions separately, are used to deploy network services dynamically, which has inspired many researchers to start developing new techniques by combining machine learning approaches to solve specific networking problems. This paper reviews RL and DRL techniques that have been studied and implemented in order to deploy SFC in 5G infrastructure networks, by providing a basic description of concepts and a clear problems explication that helps new searchers invest their effort in implementing new approaches and improving existing ones.","PeriodicalId":403927,"journal":{"name":"2022 2nd International Conference on New Technologies of Information and Communication (NTIC)","volume":"81 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 2nd International Conference on New Technologies of Information and Communication (NTIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NTIC55069.2022.10100562","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

5G networks are capable of supporting a wide range of applications with different requirements, which brings several use cases for mobile networks and increases user demands. The advancement of 5G is dependent on new technologies such as Software Defined Networks (SDN), Network Function Virtualization (NFV), and Service Function Chain (SFC). SDN enables the separation of control and data planes. NFV decouples network functions from hardware using virtualization. SFC is a popular service paradigm that has been proposed to derive maximum benefits from both NFV and SDN in 5G networks. The infrastructure of 5G networks brings a change in the network management approaches for deploying network services by allocating resources and determining optimal forwarding paths. The existing deployment methods have some shortcomings that require complete knowledge of the system. For that, Reinforcement Learning (RL) and Deep Reinforcement Learning (DRL), which have demonstrated success in solving complex control and decision-making problems by allowing network entities to learn, build knowledge, and make optimal decisions separately, are used to deploy network services dynamically, which has inspired many researchers to start developing new techniques by combining machine learning approaches to solve specific networking problems. This paper reviews RL and DRL techniques that have been studied and implemented in order to deploy SFC in 5G infrastructure networks, by providing a basic description of concepts and a clear problems explication that helps new searchers invest their effort in implementing new approaches and improving existing ones.
基于强化学习的5G网络业务功能链部署方法综述
5G网络能够支持具有不同需求的广泛应用,这为移动网络带来了多个用例,并增加了用户需求。5G的推进依赖于软件定义网络(SDN)、网络功能虚拟化(NFV)、业务功能链(SFC)等新技术。SDN实现了控制平面和数据平面的分离。NFV通过虚拟化将网络功能与硬件分离。SFC是一种流行的服务范式,旨在从5G网络的NFV和SDN中获得最大利益。5G网络的基础设施带来了网络管理方式的变革,通过资源分配和确定最优转发路径来部署网络业务。现有的部署方法存在一些缺点,需要对系统有全面的了解。为此,强化学习(RL)和深度强化学习(DRL)通过允许网络实体单独学习、构建知识和做出最佳决策,在解决复杂的控制和决策问题方面取得了成功,它们被用于动态部署网络服务,这激发了许多研究人员开始通过结合机器学习方法开发新技术来解决特定的网络问题。本文回顾了为了在5G基础设施网络中部署SFC而研究和实施的RL和DRL技术,提供了概念的基本描述和清晰的问题解释,帮助新的研究人员投入精力实施新方法和改进现有方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信