{"title":"Deep-Q: Traffic-driven QoS Inference using Deep Generative Network","authors":"Shihan Xiao, Dongdong He, Zhibo Gong","doi":"10.1145/3229543.3229549","DOIUrl":null,"url":null,"abstract":"In today's IP network, it is important to provide the Quality of Service (QoS) guarantee for network services. However, in real networks with highly dynamic traffic demands, it is difficult to build an accurate QoS model even with a high cost of human expert analysis. In this paper, we present Deep-Q, a data-driven system to learn the QoS model directly from traffic data without human analysis. This function is achieved by utilizing the power of state-of-the-art deep generative networks in the deep learning area. Deep-Q provides a novel inference structure of a variational auto-encoder (VAE) enhanced by the long short-term memory (LSTM). A specially-designed module named Cinfer-loss is further applied to improve the QoS inference accuracy. By training with real traffic data, Deep-Q can infer a variety of QoS metrics over different networks given traffic conditions in real-time. We build testbeds for both the data center network and overlay IP network. Extensive experiments with 5.7TB traffic traces demonstrate that Deep-Q can achieve on average 3x higher inference accuracy than traditional queuing-theory-based solution in real networks while keeping inference time within 100ms.","PeriodicalId":198478,"journal":{"name":"Proceedings of the 2018 Workshop on Network Meets AI & ML","volume":"31 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"46","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2018 Workshop on Network Meets AI & ML","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3229543.3229549","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 46
Abstract
In today's IP network, it is important to provide the Quality of Service (QoS) guarantee for network services. However, in real networks with highly dynamic traffic demands, it is difficult to build an accurate QoS model even with a high cost of human expert analysis. In this paper, we present Deep-Q, a data-driven system to learn the QoS model directly from traffic data without human analysis. This function is achieved by utilizing the power of state-of-the-art deep generative networks in the deep learning area. Deep-Q provides a novel inference structure of a variational auto-encoder (VAE) enhanced by the long short-term memory (LSTM). A specially-designed module named Cinfer-loss is further applied to improve the QoS inference accuracy. By training with real traffic data, Deep-Q can infer a variety of QoS metrics over different networks given traffic conditions in real-time. We build testbeds for both the data center network and overlay IP network. Extensive experiments with 5.7TB traffic traces demonstrate that Deep-Q can achieve on average 3x higher inference accuracy than traditional queuing-theory-based solution in real networks while keeping inference time within 100ms.
在当今的IP网络中,为网络业务提供QoS (Quality of Service,服务质量)保障是非常重要的。然而,在具有高度动态流量需求的真实网络中,即使人工专家分析成本很高,也很难建立准确的QoS模型。在本文中,我们提出了Deep-Q,一个数据驱动的系统,可以直接从流量数据中学习QoS模型,而无需人工分析。这个功能是通过利用深度学习领域最先进的深度生成网络的力量来实现的。Deep-Q提供了一种新的由长短期记忆(LSTM)增强的变分自编码器(VAE)推理结构。为了提高QoS的推断精度,我们还专门设计了一个名为Cinfer-loss的模块。通过使用真实流量数据进行训练,Deep-Q可以在给定流量条件的不同网络上实时推断出各种QoS指标。我们为数据中心网络和覆盖IP网络搭建了测试平台。5.7TB流量轨迹的大量实验表明,在实际网络中,Deep-Q的推理精度平均比传统的基于排队理论的解决方案高3倍,同时将推理时间保持在100ms以内。