Dexian Wang , Pengfei Zhang , Ping Deng , Qiaofeng Wu , Wei Chen , Tao Jiang , Wei Huang , Tianrui Li
{"title":"用于聚类的类似自动编码器的深度 NMF 表示学习算法","authors":"Dexian Wang , Pengfei Zhang , Ping Deng , Qiaofeng Wu , Wei Chen , Tao Jiang , Wei Huang , Tianrui Li","doi":"10.1016/j.knosys.2024.112597","DOIUrl":null,"url":null,"abstract":"<div><div>Clustering plays a crucial role in the field of data mining, where deep non-negative matrix factorization (NMF) has attracted significant attention due to its effective data representation. However, deep matrix factorization based on autoencoder is typically constructed using multi-layer matrix factorization, which ignores nonlinear mapping and lacks learning rate to guide the update. To address these issues, this paper proposes an autoencoder-like deep NMF representation learning (ADNRL) algorithm for clustering. First, according to the principle of autoencoder, construct the objective function based on NMF. Then, decouple the elements in the matrix and apply the nonlinear activation function to enforce non-negative constraints on the elements. Subsequently, the gradient values corresponding to the elements update guided by the learning rate are transformed into the weight values. This weight values are combined with the activation function to construct the ADNRL deep network, and the objective function is minimized through the learning of the network. Finally, extensive experiments are conducted on eight datasets, and the results demonstrate the superior performance of ADNRL.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":null,"pages":null},"PeriodicalIF":7.2000,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An autoencoder-like deep NMF representation learning algorithm for clustering\",\"authors\":\"Dexian Wang , Pengfei Zhang , Ping Deng , Qiaofeng Wu , Wei Chen , Tao Jiang , Wei Huang , Tianrui Li\",\"doi\":\"10.1016/j.knosys.2024.112597\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Clustering plays a crucial role in the field of data mining, where deep non-negative matrix factorization (NMF) has attracted significant attention due to its effective data representation. However, deep matrix factorization based on autoencoder is typically constructed using multi-layer matrix factorization, which ignores nonlinear mapping and lacks learning rate to guide the update. To address these issues, this paper proposes an autoencoder-like deep NMF representation learning (ADNRL) algorithm for clustering. First, according to the principle of autoencoder, construct the objective function based on NMF. Then, decouple the elements in the matrix and apply the nonlinear activation function to enforce non-negative constraints on the elements. Subsequently, the gradient values corresponding to the elements update guided by the learning rate are transformed into the weight values. This weight values are combined with the activation function to construct the ADNRL deep network, and the objective function is minimized through the learning of the network. Finally, extensive experiments are conducted on eight datasets, and the results demonstrate the superior performance of ADNRL.</div></div>\",\"PeriodicalId\":49939,\"journal\":{\"name\":\"Knowledge-Based Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2024-10-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Knowledge-Based Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0950705124012310\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124012310","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
An autoencoder-like deep NMF representation learning algorithm for clustering
Clustering plays a crucial role in the field of data mining, where deep non-negative matrix factorization (NMF) has attracted significant attention due to its effective data representation. However, deep matrix factorization based on autoencoder is typically constructed using multi-layer matrix factorization, which ignores nonlinear mapping and lacks learning rate to guide the update. To address these issues, this paper proposes an autoencoder-like deep NMF representation learning (ADNRL) algorithm for clustering. First, according to the principle of autoencoder, construct the objective function based on NMF. Then, decouple the elements in the matrix and apply the nonlinear activation function to enforce non-negative constraints on the elements. Subsequently, the gradient values corresponding to the elements update guided by the learning rate are transformed into the weight values. This weight values are combined with the activation function to construct the ADNRL deep network, and the objective function is minimized through the learning of the network. Finally, extensive experiments are conducted on eight datasets, and the results demonstrate the superior performance of ADNRL.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.