一种基于拉普拉斯平滑的投影降噪算法

Guanghua Zhao, Tao Yang, Dongmei Fu
{"title":"一种基于拉普拉斯平滑的投影降噪算法","authors":"Guanghua Zhao, Tao Yang, Dongmei Fu","doi":"10.1109/ICCSMT54525.2021.00051","DOIUrl":null,"url":null,"abstract":"In order to avoid the curse of dimensionality, which is often encountered in big data analysis, manifold learning assumes that high-dimensional data is embedded in a low-dimensional smooth manifold. However, in practical applications, the data sets often contain inevitable noise, and the manifold learning algorithm itself is often sensitive to noise. Therefore, in order to reduce the interference of noise to the manifold learning algorithm, we propose a new projective noise reduction algorithm based on Laplacian smoothing. The main idea of this algorithm is to perform Laplacian smoothing on a data set before projection of the sample points, so that the data set can present expected manifold structure, which solves the problem that the sample points are too scattered and deviated from the main manifold well. In avoid of the over-smoothing problem caused by Laplacian smoothing algorithm, we propose to control the number of iterations based on the variance reduction. The experimental results show that the proposed algorithm can reduce the noise as well as maintain the manifold structure, and the noise reduction effect is superior to the traditional noise reduction algorithm.","PeriodicalId":304337,"journal":{"name":"2021 2nd International Conference on Computer Science and Management Technology (ICCSMT)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Projective Noise Reduction Algorithm Based on Laplacian Smoothing\",\"authors\":\"Guanghua Zhao, Tao Yang, Dongmei Fu\",\"doi\":\"10.1109/ICCSMT54525.2021.00051\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to avoid the curse of dimensionality, which is often encountered in big data analysis, manifold learning assumes that high-dimensional data is embedded in a low-dimensional smooth manifold. However, in practical applications, the data sets often contain inevitable noise, and the manifold learning algorithm itself is often sensitive to noise. Therefore, in order to reduce the interference of noise to the manifold learning algorithm, we propose a new projective noise reduction algorithm based on Laplacian smoothing. The main idea of this algorithm is to perform Laplacian smoothing on a data set before projection of the sample points, so that the data set can present expected manifold structure, which solves the problem that the sample points are too scattered and deviated from the main manifold well. In avoid of the over-smoothing problem caused by Laplacian smoothing algorithm, we propose to control the number of iterations based on the variance reduction. The experimental results show that the proposed algorithm can reduce the noise as well as maintain the manifold structure, and the noise reduction effect is superior to the traditional noise reduction algorithm.\",\"PeriodicalId\":304337,\"journal\":{\"name\":\"2021 2nd International Conference on Computer Science and Management Technology (ICCSMT)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 2nd International Conference on Computer Science and Management Technology (ICCSMT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCSMT54525.2021.00051\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 2nd International Conference on Computer Science and Management Technology (ICCSMT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCSMT54525.2021.00051","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

为了避免在大数据分析中经常遇到的维数诅咒,流形学习假设高维数据嵌入在低维光滑流形中。然而,在实际应用中,数据集往往包含不可避免的噪声,而流形学习算法本身往往对噪声敏感。因此,为了减少噪声对流形学习算法的干扰,我们提出了一种新的基于拉普拉斯平滑的投影降噪算法。该算法的主要思想是在样本点投影前对数据集进行拉普拉斯平滑处理,使数据集呈现出预期的流形结构,很好地解决了样本点过于分散和偏离主流形的问题。为了避免拉普拉斯平滑算法造成的过度平滑问题,我们提出了基于方差缩减的迭代次数控制方法。实验结果表明,该算法能够在保持流形结构的同时降低噪声,降噪效果优于传统的降噪算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Projective Noise Reduction Algorithm Based on Laplacian Smoothing
In order to avoid the curse of dimensionality, which is often encountered in big data analysis, manifold learning assumes that high-dimensional data is embedded in a low-dimensional smooth manifold. However, in practical applications, the data sets often contain inevitable noise, and the manifold learning algorithm itself is often sensitive to noise. Therefore, in order to reduce the interference of noise to the manifold learning algorithm, we propose a new projective noise reduction algorithm based on Laplacian smoothing. The main idea of this algorithm is to perform Laplacian smoothing on a data set before projection of the sample points, so that the data set can present expected manifold structure, which solves the problem that the sample points are too scattered and deviated from the main manifold well. In avoid of the over-smoothing problem caused by Laplacian smoothing algorithm, we propose to control the number of iterations based on the variance reduction. The experimental results show that the proposed algorithm can reduce the noise as well as maintain the manifold structure, and the noise reduction effect is superior to the traditional noise reduction algorithm.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信