Edwin F. Galutira, Arnel C. Fajardo, Ruji P. Medina
{"title":"A Novel Learning Rate Decay Function of Kohonen Self-Organizing Maps Using the Exponential Decay Average Rate of Change for Image Clustering","authors":"Edwin F. Galutira, Arnel C. Fajardo, Ruji P. Medina","doi":"10.1145/3278293.3278299","DOIUrl":null,"url":null,"abstract":"Clustering requires efficient selection of similarities among sample vectors and true clustering capability of the algorithm. The Kohonen Self-Organizing Maps is the most preferred unsupervised Artificial Neural Network clustering algorithm for high-dimensional or multi-dimensional data. This study introduces a new way of improving the clustering capability of the algorithm by enhancing its learning rate decay function to decrease its learning rate gradually as the training goes on through the use of the Exponential Decay Average Rate of Change. The new function allows the Enhanced Kohonen Self-Organizing Maps algorithm to converge to the minimum producing a more robust clustered datasets. The enhanced algorithm and the conventional algorithm were applied for image clustering, and the EKSOM remarkably outperformed the clustering capability of the KSOM. The introduction of EDARC function paves the way to explore the clustering and classification capability of KSOM further.","PeriodicalId":183745,"journal":{"name":"Proceedings of the 2nd International Conference on Natural Language Processing and Information Retrieval","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2nd International Conference on Natural Language Processing and Information Retrieval","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3278293.3278299","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
Clustering requires efficient selection of similarities among sample vectors and true clustering capability of the algorithm. The Kohonen Self-Organizing Maps is the most preferred unsupervised Artificial Neural Network clustering algorithm for high-dimensional or multi-dimensional data. This study introduces a new way of improving the clustering capability of the algorithm by enhancing its learning rate decay function to decrease its learning rate gradually as the training goes on through the use of the Exponential Decay Average Rate of Change. The new function allows the Enhanced Kohonen Self-Organizing Maps algorithm to converge to the minimum producing a more robust clustered datasets. The enhanced algorithm and the conventional algorithm were applied for image clustering, and the EKSOM remarkably outperformed the clustering capability of the KSOM. The introduction of EDARC function paves the way to explore the clustering and classification capability of KSOM further.
聚类需要有效地选择样本向量之间的相似性和算法的真实聚类能力。Kohonen自组织图是高维或多维数据最常用的无监督人工神经网络聚类算法。本研究引入了一种提高算法聚类能力的新方法,通过使用指数衰减平均变化率(Exponential decay Average rate of Change)来增强算法的学习率衰减函数,使其学习率随着训练的进行而逐渐降低。新功能允许增强Kohonen自组织映射算法收敛到最小,产生更健壮的聚类数据集。将增强算法和传统算法应用于图像聚类,结果表明,EKSOM的聚类能力明显优于KSOM。EDARC函数的引入为进一步探索KSOM的聚类和分类能力铺平了道路。