Eleftherios Kofidis, Paris V. Giampouras, A. Rontogiannis
{"title":"揭示秩的非负块项张量分解的投影牛顿型算法","authors":"Eleftherios Kofidis, Paris V. Giampouras, A. Rontogiannis","doi":"10.23919/eusipco55093.2022.9909799","DOIUrl":null,"url":null,"abstract":"The block-term tensor decomposition (BTD) model has been receiving increasing attention as a quite flexible way to capture the structure of 3-dimensional data that can be naturally viewed as the superposition of $R$ block terms of multilinear rank ($L_{r}, L_{r}, 1), r=1,2,\\ldots,R$. Versions with nonnegativity constraints, especially relevant in applications like blind source separation problems, have only recently been proposed and they all share the need to have an a-priori knowledge of the number of block terms, $R$, and their individual ranks, $L_{i}$. Clearly, the latter requirement may severely limit their practical applicability. Building upon earlier work of ours on unconstrained BTD model selection and computation, we develop for the first time in this paper a method for nonnegative BTD approximation that is also rank-revealing. The idea is to impose column sparsity jointly on the factors and successively estimate the ranks as the numbers of factor columns of non-negligible magnitude. This is effected with the aid of nonnegative alternating iteratively reweighted least squares, implemented via projected Newton updates for increased convergence rate and accuracy. Simulation results are reported that demonstrate the effectiveness of our method in accurately estimating both the ranks and the factors of the nonnegative least squares BTD approximation.","PeriodicalId":231263,"journal":{"name":"2022 30th European Signal Processing Conference (EUSIPCO)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"A Projected Newton-type Algorithm for Rank - revealing Nonnegative Block - Term Tensor Decomposition\",\"authors\":\"Eleftherios Kofidis, Paris V. Giampouras, A. Rontogiannis\",\"doi\":\"10.23919/eusipco55093.2022.9909799\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The block-term tensor decomposition (BTD) model has been receiving increasing attention as a quite flexible way to capture the structure of 3-dimensional data that can be naturally viewed as the superposition of $R$ block terms of multilinear rank ($L_{r}, L_{r}, 1), r=1,2,\\\\ldots,R$. Versions with nonnegativity constraints, especially relevant in applications like blind source separation problems, have only recently been proposed and they all share the need to have an a-priori knowledge of the number of block terms, $R$, and their individual ranks, $L_{i}$. Clearly, the latter requirement may severely limit their practical applicability. Building upon earlier work of ours on unconstrained BTD model selection and computation, we develop for the first time in this paper a method for nonnegative BTD approximation that is also rank-revealing. The idea is to impose column sparsity jointly on the factors and successively estimate the ranks as the numbers of factor columns of non-negligible magnitude. This is effected with the aid of nonnegative alternating iteratively reweighted least squares, implemented via projected Newton updates for increased convergence rate and accuracy. Simulation results are reported that demonstrate the effectiveness of our method in accurately estimating both the ranks and the factors of the nonnegative least squares BTD approximation.\",\"PeriodicalId\":231263,\"journal\":{\"name\":\"2022 30th European Signal Processing Conference (EUSIPCO)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 30th European Signal Processing Conference (EUSIPCO)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23919/eusipco55093.2022.9909799\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 30th European Signal Processing Conference (EUSIPCO)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/eusipco55093.2022.9909799","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
摘要
块项张量分解(BTD)模型作为一种非常灵活的捕获三维数据结构的方法而受到越来越多的关注,三维数据可以很自然地看作是多元线性秩($L_{R}, L_{R}, 1), R =1,2,\ldots,R$的块项R$的叠加。具有非负性约束的版本,特别是与盲源分离问题等应用相关的版本,直到最近才被提出,它们都需要具有块项数量的先验知识,$R$和它们的单个秩,$L_{i}$。显然,后一项要求可能严重限制它们的实际适用性。在我们之前关于无约束BTD模型选择和计算的工作的基础上,我们在本文中首次开发了一种非负BTD近似方法,该方法也具有秩揭示性。其思想是对因子联合施加列稀疏性,并依次估计作为不可忽略量级的因子列的数量的秩。这是借助于非负交替迭代加权最小二乘实现的,通过投影牛顿更新实现,以提高收敛速度和精度。仿真结果表明,该方法能够准确估计非负最小二乘BTD近似的秩和因子。
A Projected Newton-type Algorithm for Rank - revealing Nonnegative Block - Term Tensor Decomposition
The block-term tensor decomposition (BTD) model has been receiving increasing attention as a quite flexible way to capture the structure of 3-dimensional data that can be naturally viewed as the superposition of $R$ block terms of multilinear rank ($L_{r}, L_{r}, 1), r=1,2,\ldots,R$. Versions with nonnegativity constraints, especially relevant in applications like blind source separation problems, have only recently been proposed and they all share the need to have an a-priori knowledge of the number of block terms, $R$, and their individual ranks, $L_{i}$. Clearly, the latter requirement may severely limit their practical applicability. Building upon earlier work of ours on unconstrained BTD model selection and computation, we develop for the first time in this paper a method for nonnegative BTD approximation that is also rank-revealing. The idea is to impose column sparsity jointly on the factors and successively estimate the ranks as the numbers of factor columns of non-negligible magnitude. This is effected with the aid of nonnegative alternating iteratively reweighted least squares, implemented via projected Newton updates for increased convergence rate and accuracy. Simulation results are reported that demonstrate the effectiveness of our method in accurately estimating both the ranks and the factors of the nonnegative least squares BTD approximation.