Network Flow Generation Based on Reinforcement Learning Powered Generative Adversarial Network

Jianxu Li, Yang Xiao, Jiawei Wu, Jialong Feng, Jun Liu
{"title":"Network Flow Generation Based on Reinforcement Learning Powered Generative Adversarial Network","authors":"Jianxu Li, Yang Xiao, Jiawei Wu, Jialong Feng, Jun Liu","doi":"10.1109/IC-NIDC54101.2021.9660491","DOIUrl":null,"url":null,"abstract":"Mining anomalies and special events from massive network flows based on machine learning and deep learning is a promising approach for network management. However, it is difficult to build labeled network flow data sets for training machine learning and deep learning models. In this paper, we propose a novel reinforcement learning (RL) powered generative adversarial network (GAN) model named NF-GAN for network flow generation. The generator of NF-GAN is designed as a stochastic policy model to generate labeled network flow data. In terms of the discriminator, a check reward is integrated into the network reward to capture the correlations among attributes. Experiment results demonstrate that the majority of the generated flows conform to the strict network protocols of the standard OSI stack, and the success rate of network flows generation achieves 99.96%. To the best of our knowledge, this is the first time of applying RL powered GAN on network flow generation tasks.","PeriodicalId":264468,"journal":{"name":"2021 7th IEEE International Conference on Network Intelligence and Digital Content (IC-NIDC)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 7th IEEE International Conference on Network Intelligence and Digital Content (IC-NIDC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IC-NIDC54101.2021.9660491","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

Mining anomalies and special events from massive network flows based on machine learning and deep learning is a promising approach for network management. However, it is difficult to build labeled network flow data sets for training machine learning and deep learning models. In this paper, we propose a novel reinforcement learning (RL) powered generative adversarial network (GAN) model named NF-GAN for network flow generation. The generator of NF-GAN is designed as a stochastic policy model to generate labeled network flow data. In terms of the discriminator, a check reward is integrated into the network reward to capture the correlations among attributes. Experiment results demonstrate that the majority of the generated flows conform to the strict network protocols of the standard OSI stack, and the success rate of network flows generation achieves 99.96%. To the best of our knowledge, this is the first time of applying RL powered GAN on network flow generation tasks.
基于强化学习生成对抗网络的网络流生成
基于机器学习和深度学习从海量网络流中挖掘异常和特殊事件是一种很有前途的网络管理方法。然而,建立标记的网络流数据集用于训练机器学习和深度学习模型是很困难的。在本文中,我们提出了一种新的强化学习(RL)驱动的生成对抗网络(GAN)模型,称为NF-GAN,用于网络流生成。NF-GAN的生成器设计为随机策略模型,用于生成标记的网络流数据。在鉴别器方面,将检查奖励集成到网络奖励中,以捕获属性之间的相关性。实验结果表明,生成的网络流大部分符合标准OSI栈的严格网络协议,网络流生成成功率达到99.96%。据我们所知,这是第一次将强化学习驱动的GAN应用于网络流生成任务。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信