基于CUR分解的互联网流量矩阵压缩感知

Awnish Kumar, V. Saradhi, T. Venkatesh
{"title":"基于CUR分解的互联网流量矩阵压缩感知","authors":"Awnish Kumar, V. Saradhi, T. Venkatesh","doi":"10.1145/3154273.3154315","DOIUrl":null,"url":null,"abstract":"Missing values in traffic matrix (TM) is a well known fact which needs to be interpolated with least error as TM is a key input to various network operations and management tasks. Compressive sensing deals with the reconstruction of missing observations by taking advantage of the presence of low-rank structure in TMs. Matrix decomposition techniques, more specifically singular value decomposition (SVD) and its variants such as sparsity regularized matrix factorization (SRMF) and sparsity regularized SVD (SRSVD), has attracted considerable attention in the field of compressive sensing of traffic matrices. However, SVD suffers from two limitations stemmed in its assumptions, which involves an assumption of continuous random variables and lack of interpretability of decomposed matrices. In the present work, in order to address the above-identified limitations we develop a simple yet powerful compressive sensing framework with two key components: i) Temporally Local Interpolation (TLI) and ii) CUR decomposition. We utilize a publicly available real traffic matrix obtained from Abilene network. Results show that i) our preprocessing technique, TLI, outperforms existing baseline approximation in terms of exhibiting least error in reconstruction of missing values with loss rates ranging from 1% to 98%. ii) The proposed framework can reconstruct up to 98% of the pure random missing data with an error of 29.8%, which is found to be comparatively better than SVD-based approaches. iii) When augmented with k-Nearest Neighbors (KNN), the proposed framework can reconstruct up to 98% of the pure random missing data with an error of 28.9%, which is comparatively better than (SRMF + KNN) and (SRSVDB + KNN). iv) The proposed framework is also found to be computationally efficient in terms of low computational time as it takes less than 0.7 seconds (using Matlab on a 3.20 GHz Windows machine), which is the least computational time taken as compared to SRMF (3.02 seconds), NMF (1.01 seconds), SRSVD (1.00 second) and SRSVD base (0.83 seconds).","PeriodicalId":276042,"journal":{"name":"Proceedings of the 19th International Conference on Distributed Computing and Networking","volume":"135 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Compressive Sensing of Internet Traffic Matrices using CUR Decomposition\",\"authors\":\"Awnish Kumar, V. Saradhi, T. Venkatesh\",\"doi\":\"10.1145/3154273.3154315\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Missing values in traffic matrix (TM) is a well known fact which needs to be interpolated with least error as TM is a key input to various network operations and management tasks. Compressive sensing deals with the reconstruction of missing observations by taking advantage of the presence of low-rank structure in TMs. Matrix decomposition techniques, more specifically singular value decomposition (SVD) and its variants such as sparsity regularized matrix factorization (SRMF) and sparsity regularized SVD (SRSVD), has attracted considerable attention in the field of compressive sensing of traffic matrices. However, SVD suffers from two limitations stemmed in its assumptions, which involves an assumption of continuous random variables and lack of interpretability of decomposed matrices. In the present work, in order to address the above-identified limitations we develop a simple yet powerful compressive sensing framework with two key components: i) Temporally Local Interpolation (TLI) and ii) CUR decomposition. We utilize a publicly available real traffic matrix obtained from Abilene network. Results show that i) our preprocessing technique, TLI, outperforms existing baseline approximation in terms of exhibiting least error in reconstruction of missing values with loss rates ranging from 1% to 98%. ii) The proposed framework can reconstruct up to 98% of the pure random missing data with an error of 29.8%, which is found to be comparatively better than SVD-based approaches. iii) When augmented with k-Nearest Neighbors (KNN), the proposed framework can reconstruct up to 98% of the pure random missing data with an error of 28.9%, which is comparatively better than (SRMF + KNN) and (SRSVDB + KNN). iv) The proposed framework is also found to be computationally efficient in terms of low computational time as it takes less than 0.7 seconds (using Matlab on a 3.20 GHz Windows machine), which is the least computational time taken as compared to SRMF (3.02 seconds), NMF (1.01 seconds), SRSVD (1.00 second) and SRSVD base (0.83 seconds).\",\"PeriodicalId\":276042,\"journal\":{\"name\":\"Proceedings of the 19th International Conference on Distributed Computing and Networking\",\"volume\":\"135 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-01-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 19th International Conference on Distributed Computing and Networking\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3154273.3154315\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 19th International Conference on Distributed Computing and Networking","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3154273.3154315","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

摘要

由于流量矩阵是各种网络操作和管理任务的关键输入,因此需要以最小误差插值流量矩阵中的缺失值是众所周知的事实。压缩感知利用tm中存在的低秩结构来处理缺失观测值的重建。矩阵分解技术,特别是奇异值分解(SVD)及其变体,如稀疏正则矩阵分解(SRMF)和稀疏正则奇异值分解(SRSVD),在交通矩阵压缩感知领域引起了广泛的关注。然而,奇异值分解在假设上存在两个局限性,即假设连续随机变量和分解矩阵缺乏可解释性。在目前的工作中,为了解决上述局限性,我们开发了一个简单而强大的压缩感知框架,其中包含两个关键组件:i)时间局部插值(TLI)和ii) CUR分解。我们利用从阿比林网络获得的公开可用的真实流量矩阵。结果表明:(1)我们的预处理技术,TLI,在缺失值重建方面表现出最小的误差,损失率在1%到98%之间,优于现有的基线近似。ii)该框架可重构高达98%的纯随机缺失数据,误差为29.8%,相对于基于奇异值分解的方法。iii)当与k近邻(KNN)增强时,该框架可以重构98%的纯随机缺失数据,误差为28.9%,相对优于(SRMF + KNN)和(SRSVDB + KNN)。iv)所提出的框架也被发现在低计算时间方面具有计算效率,因为它需要不到0.7秒(在3.20 GHz Windows机器上使用Matlab),与SRMF(3.02秒),NMF(1.01秒),SRSVD(1.00秒)和SRSVD基(0.83秒)相比,这是最少的计算时间。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Compressive Sensing of Internet Traffic Matrices using CUR Decomposition
Missing values in traffic matrix (TM) is a well known fact which needs to be interpolated with least error as TM is a key input to various network operations and management tasks. Compressive sensing deals with the reconstruction of missing observations by taking advantage of the presence of low-rank structure in TMs. Matrix decomposition techniques, more specifically singular value decomposition (SVD) and its variants such as sparsity regularized matrix factorization (SRMF) and sparsity regularized SVD (SRSVD), has attracted considerable attention in the field of compressive sensing of traffic matrices. However, SVD suffers from two limitations stemmed in its assumptions, which involves an assumption of continuous random variables and lack of interpretability of decomposed matrices. In the present work, in order to address the above-identified limitations we develop a simple yet powerful compressive sensing framework with two key components: i) Temporally Local Interpolation (TLI) and ii) CUR decomposition. We utilize a publicly available real traffic matrix obtained from Abilene network. Results show that i) our preprocessing technique, TLI, outperforms existing baseline approximation in terms of exhibiting least error in reconstruction of missing values with loss rates ranging from 1% to 98%. ii) The proposed framework can reconstruct up to 98% of the pure random missing data with an error of 29.8%, which is found to be comparatively better than SVD-based approaches. iii) When augmented with k-Nearest Neighbors (KNN), the proposed framework can reconstruct up to 98% of the pure random missing data with an error of 28.9%, which is comparatively better than (SRMF + KNN) and (SRSVDB + KNN). iv) The proposed framework is also found to be computationally efficient in terms of low computational time as it takes less than 0.7 seconds (using Matlab on a 3.20 GHz Windows machine), which is the least computational time taken as compared to SRMF (3.02 seconds), NMF (1.01 seconds), SRSVD (1.00 second) and SRSVD base (0.83 seconds).
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信