Robust Principal Component Analysis Based on Globally-convergent Iteratively Reweighted Least Squares

Weihao Li, Jiu-lun Fan, Xiao-bin Zhi, Xurui Luo
{"title":"Robust Principal Component Analysis Based on Globally-convergent Iteratively Reweighted Least Squares","authors":"Weihao Li, Jiu-lun Fan, Xiao-bin Zhi, Xurui Luo","doi":"10.1145/3573942.3574101","DOIUrl":null,"url":null,"abstract":"Classical Robust Principal Component Analysis (RPCA) uses the singular value threshold operator (SVT) to solve for the convex approximation of the nuclear norm with respect to the rank of a matrix. However, when the matrix size is large, the SVT operator has a slow convergent speed and high computational complexity. To solve the above problems, in this paper, we propose a Robust principal component analysis algorithm based on Global-convergent Iteratively Reweighted Least Squares (RPCA/GIRLS). In the first stage, the low-rank matrix in the original RPCA model is decomposed into two column-sparse matrix factor products, and the two matrix factors are solved via alternating iteratively reweighted least squares algorithms (AIRLS), thus reducing the computational complexity. However, since the AIRLS is sensitive to the initialization, the updated matrix factor in the first stage is used as the new input data matrix in the second stage, and the matrix factor is updated by the gradient descent step, and finally the optimal low-rank matrix that satisfies the global convergent conditions is obtained. We have conducted extensive experiments on six public video data sets, by comparing the background separation effects of these six videos and calculating their quantitative evaluation indexes, the effectiveness and superiority of the proposed algorithm are verified from both subjective and objective perspectives.","PeriodicalId":103293,"journal":{"name":"Proceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern Recognition","volume":"20 3 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern Recognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3573942.3574101","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Classical Robust Principal Component Analysis (RPCA) uses the singular value threshold operator (SVT) to solve for the convex approximation of the nuclear norm with respect to the rank of a matrix. However, when the matrix size is large, the SVT operator has a slow convergent speed and high computational complexity. To solve the above problems, in this paper, we propose a Robust principal component analysis algorithm based on Global-convergent Iteratively Reweighted Least Squares (RPCA/GIRLS). In the first stage, the low-rank matrix in the original RPCA model is decomposed into two column-sparse matrix factor products, and the two matrix factors are solved via alternating iteratively reweighted least squares algorithms (AIRLS), thus reducing the computational complexity. However, since the AIRLS is sensitive to the initialization, the updated matrix factor in the first stage is used as the new input data matrix in the second stage, and the matrix factor is updated by the gradient descent step, and finally the optimal low-rank matrix that satisfies the global convergent conditions is obtained. We have conducted extensive experiments on six public video data sets, by comparing the background separation effects of these six videos and calculating their quantitative evaluation indexes, the effectiveness and superiority of the proposed algorithm are verified from both subjective and objective perspectives.
基于全局收敛迭代加权最小二乘的鲁棒主成分分析
经典鲁棒主成分分析(RPCA)采用奇异值阈值算子(SVT)求解核范数相对于矩阵秩的凸逼近。然而,当矩阵大小较大时,SVT算子收敛速度慢,计算复杂度高。为了解决上述问题,本文提出了一种基于全局收敛迭代加权最小二乘(RPCA/GIRLS)的鲁棒主成分分析算法。第一阶段,将原RPCA模型中的低秩矩阵分解为两个列稀疏矩阵因子积,并通过交替迭代重加权最小二乘算法(AIRLS)求解两个矩阵因子,从而降低了计算复杂度。然而,由于AIRLS对初始化敏感,将第一阶段更新的矩阵因子作为第二阶段新的输入数据矩阵,并通过梯度下降步更新矩阵因子,最终得到满足全局收敛条件的最优低秩矩阵。我们在6个公开的视频数据集上进行了大量的实验,通过对比这6个视频的背景分离效果,并计算其定量评价指标,从主观和客观两个角度验证了本文算法的有效性和优越性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信