Hua Chai, Jiao Zhang, Zenan Wang, Jiaming Shi, Tao Huang
{"title":"基于深度强化学习的业务功能链并行布局方法","authors":"Hua Chai, Jiao Zhang, Zenan Wang, Jiaming Shi, Tao Huang","doi":"10.1109/ICCC47050.2019.9064448","DOIUrl":null,"url":null,"abstract":"Network Function Virtualization (NFV) enables service flexibility and cost reduction by replacing traditional hardware middle-boxes with Virtual Network Functions (VNFs) running on general-purpose servers. Normally, network traffic usually needs to pass through several VNFs in a particular order. This phenomenon is known as Service Function Chaining (SFC). How to place SFCs with minimal resource is still an open problem. Most of the existing work thinks it's difficult to find the placement solution for all SFCs as a whole, they, instead, consider each demand sequentially, and deploy SFCs one by one. But such serial placement lacks consideration of the interrelations among demands and unable to minimize resource. In this paper, we innovatively propose a parallel deployment scheme based on Deep Reinforcement Learning (DRL). It satisfies demands with minimum resource. We design an overall SFC placement scheme for all demands, and deploy all SFCs simultaneously. We evaluate the proposed algorithms using extensive simulations and prototype experiments. The result demonstrates that our parallel deployment approach minimized resource costs compared with other schemes.","PeriodicalId":6739,"journal":{"name":"2019 IEEE 5th International Conference on Computer and Communications (ICCC)","volume":"41 1","pages":"2123-2128"},"PeriodicalIF":0.0000,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"11","resultStr":"{\"title\":\"A Parallel Placement Approach for Service Function Chain Using Deep Reinforcement Learning\",\"authors\":\"Hua Chai, Jiao Zhang, Zenan Wang, Jiaming Shi, Tao Huang\",\"doi\":\"10.1109/ICCC47050.2019.9064448\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Network Function Virtualization (NFV) enables service flexibility and cost reduction by replacing traditional hardware middle-boxes with Virtual Network Functions (VNFs) running on general-purpose servers. Normally, network traffic usually needs to pass through several VNFs in a particular order. This phenomenon is known as Service Function Chaining (SFC). How to place SFCs with minimal resource is still an open problem. Most of the existing work thinks it's difficult to find the placement solution for all SFCs as a whole, they, instead, consider each demand sequentially, and deploy SFCs one by one. But such serial placement lacks consideration of the interrelations among demands and unable to minimize resource. In this paper, we innovatively propose a parallel deployment scheme based on Deep Reinforcement Learning (DRL). It satisfies demands with minimum resource. We design an overall SFC placement scheme for all demands, and deploy all SFCs simultaneously. We evaluate the proposed algorithms using extensive simulations and prototype experiments. The result demonstrates that our parallel deployment approach minimized resource costs compared with other schemes.\",\"PeriodicalId\":6739,\"journal\":{\"name\":\"2019 IEEE 5th International Conference on Computer and Communications (ICCC)\",\"volume\":\"41 1\",\"pages\":\"2123-2128\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"11\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE 5th International Conference on Computer and Communications (ICCC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCC47050.2019.9064448\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE 5th International Conference on Computer and Communications (ICCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCC47050.2019.9064448","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 11
摘要
网络功能虚拟化(Network Function Virtualization, NFV)通过使用运行在通用服务器上的虚拟网络功能(Virtual Network Functions, VNFs)取代传统的硬件中间盒,实现业务灵活性和降低成本。通常,网络流量通常需要以特定的顺序通过几个VNFs。这种现象被称为业务功能链(SFC)。如何用最少的资源安置SFCs仍然是一个悬而未决的问题。现有的大部分工作都认为很难从整体上找到所有sfc的部署方案,而是按顺序考虑每个需求,逐个部署sfc。但这种连续布局缺乏对需求间相互关系的考虑,无法实现资源的最小化。在本文中,我们创新地提出了一种基于深度强化学习(DRL)的并行部署方案。它以最少的资源满足需求。我们为所有需求设计了一个整体的SFC安置方案,并同时部署所有SFC。我们通过广泛的模拟和原型实验来评估所提出的算法。结果表明,与其他方案相比,我们的并行部署方法最大限度地降低了资源成本。
A Parallel Placement Approach for Service Function Chain Using Deep Reinforcement Learning
Network Function Virtualization (NFV) enables service flexibility and cost reduction by replacing traditional hardware middle-boxes with Virtual Network Functions (VNFs) running on general-purpose servers. Normally, network traffic usually needs to pass through several VNFs in a particular order. This phenomenon is known as Service Function Chaining (SFC). How to place SFCs with minimal resource is still an open problem. Most of the existing work thinks it's difficult to find the placement solution for all SFCs as a whole, they, instead, consider each demand sequentially, and deploy SFCs one by one. But such serial placement lacks consideration of the interrelations among demands and unable to minimize resource. In this paper, we innovatively propose a parallel deployment scheme based on Deep Reinforcement Learning (DRL). It satisfies demands with minimum resource. We design an overall SFC placement scheme for all demands, and deploy all SFCs simultaneously. We evaluate the proposed algorithms using extensive simulations and prototype experiments. The result demonstrates that our parallel deployment approach minimized resource costs compared with other schemes.