基于LEML的SPD矩阵鲁棒软LVQ

IF 5.3 3区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Fengzhen Tang;Xiaocheng Zhang
{"title":"基于LEML的SPD矩阵鲁棒软LVQ","authors":"Fengzhen Tang;Xiaocheng Zhang","doi":"10.1109/TETCI.2024.3515009","DOIUrl":null,"url":null,"abstract":"Many learning scenarios involve non-Euclidean data. For instance, in electroencephalogram (EEG) or image classification, the input can be characterized by symmetric positive-definite (SPD) matrices. These matrices live on the curved Riemannian manifold instead of the flat Euclidean space. In such situations, classical Euclidean learning methods may fail due to the non-Euclidean nature of the data. This article proposes to generalize robust soft learning vector quantization (RSLVQ) targeted for Euclidean data to cope with such data in the log-Euclidean framework. Log-Euclidean metric learning (LEML) is incorporated into the RSLVQ framework, jointly learning the prototypes on the manifold and the distance metric tensor of the tangent map that projects the original tangent space to a more discriminative one. Two methods are subsequently proposed to learn the distance metric tensor. It is firstly confined to have full rank and treated as an SPD matrix, which is learned using the log-Euclidean framework. Then, this constraint is removed letting it become a symmetric positive semidefinite (SPSD) matrix, which is learned using the quotient geometry. In addition, we propose to adapt the variance parameter introduced in the probabilistic modelling during the training course of the classifier by the minimization of the negative log likelihood function with respect to this parameter. Experiments on multiple data sets with different properties show the proposed methods have good classification performances and low computational complexities.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":"9 4","pages":"2995-3009"},"PeriodicalIF":5.3000,"publicationDate":"2024-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10816565","citationCount":"0","resultStr":"{\"title\":\"Robust Soft LVQ With LEML for SPD Matrices\",\"authors\":\"Fengzhen Tang;Xiaocheng Zhang\",\"doi\":\"10.1109/TETCI.2024.3515009\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Many learning scenarios involve non-Euclidean data. For instance, in electroencephalogram (EEG) or image classification, the input can be characterized by symmetric positive-definite (SPD) matrices. These matrices live on the curved Riemannian manifold instead of the flat Euclidean space. In such situations, classical Euclidean learning methods may fail due to the non-Euclidean nature of the data. This article proposes to generalize robust soft learning vector quantization (RSLVQ) targeted for Euclidean data to cope with such data in the log-Euclidean framework. Log-Euclidean metric learning (LEML) is incorporated into the RSLVQ framework, jointly learning the prototypes on the manifold and the distance metric tensor of the tangent map that projects the original tangent space to a more discriminative one. Two methods are subsequently proposed to learn the distance metric tensor. It is firstly confined to have full rank and treated as an SPD matrix, which is learned using the log-Euclidean framework. Then, this constraint is removed letting it become a symmetric positive semidefinite (SPSD) matrix, which is learned using the quotient geometry. In addition, we propose to adapt the variance parameter introduced in the probabilistic modelling during the training course of the classifier by the minimization of the negative log likelihood function with respect to this parameter. Experiments on multiple data sets with different properties show the proposed methods have good classification performances and low computational complexities.\",\"PeriodicalId\":13135,\"journal\":{\"name\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"volume\":\"9 4\",\"pages\":\"2995-3009\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-12-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10816565\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10816565/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Emerging Topics in Computational Intelligence","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10816565/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

许多学习场景涉及非欧几里德数据。例如,在脑电图(EEG)或图像分类中,输入可以用对称正定(SPD)矩阵来表征。这些矩阵存在于弯曲的黎曼流形中,而不是平坦的欧几里德空间中。在这种情况下,由于数据的非欧几里得性质,经典的欧几里得学习方法可能会失败。本文提出了一种针对欧几里得数据的鲁棒软学习向量量化(RSLVQ)的泛化方法,以在对数-欧几里得框架下处理这类数据。将对数欧几里得度量学习(LEML)纳入RSLVQ框架,共同学习流形上的原型和将原始切线空间投影到更具判别性的切线映射的距离度量张量。随后提出了两种学习距离度量张量的方法。首先将其限定为满秩,并将其作为SPD矩阵,利用对数-欧几里得框架进行学习。然后,这个约束被移除,使它成为一个对称的正半定(SPSD)矩阵,这是使用商几何学习的。此外,我们提出在分类器的训练过程中,通过最小化关于该参数的负对数似然函数来适应概率建模中引入的方差参数。在多个不同属性数据集上的实验表明,该方法具有良好的分类性能和较低的计算复杂度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Robust Soft LVQ With LEML for SPD Matrices
Many learning scenarios involve non-Euclidean data. For instance, in electroencephalogram (EEG) or image classification, the input can be characterized by symmetric positive-definite (SPD) matrices. These matrices live on the curved Riemannian manifold instead of the flat Euclidean space. In such situations, classical Euclidean learning methods may fail due to the non-Euclidean nature of the data. This article proposes to generalize robust soft learning vector quantization (RSLVQ) targeted for Euclidean data to cope with such data in the log-Euclidean framework. Log-Euclidean metric learning (LEML) is incorporated into the RSLVQ framework, jointly learning the prototypes on the manifold and the distance metric tensor of the tangent map that projects the original tangent space to a more discriminative one. Two methods are subsequently proposed to learn the distance metric tensor. It is firstly confined to have full rank and treated as an SPD matrix, which is learned using the log-Euclidean framework. Then, this constraint is removed letting it become a symmetric positive semidefinite (SPSD) matrix, which is learned using the quotient geometry. In addition, we propose to adapt the variance parameter introduced in the probabilistic modelling during the training course of the classifier by the minimization of the negative log likelihood function with respect to this parameter. Experiments on multiple data sets with different properties show the proposed methods have good classification performances and low computational complexities.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
10.30
自引率
7.50%
发文量
147
期刊介绍: The IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI) publishes original articles on emerging aspects of computational intelligence, including theory, applications, and surveys. TETCI is an electronics only publication. TETCI publishes six issues per year. Authors are encouraged to submit manuscripts in any emerging topic in computational intelligence, especially nature-inspired computing topics not covered by other IEEE Computational Intelligence Society journals. A few such illustrative examples are glial cell networks, computational neuroscience, Brain Computer Interface, ambient intelligence, non-fuzzy computing with words, artificial life, cultural learning, artificial endocrine networks, social reasoning, artificial hormone networks, computational intelligence for the IoT and Smart-X technologies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信