{"title":"A dictionary learning algorithm for sparse coding by the normalized bilateral projections","authors":"Taro Tezuka","doi":"10.1109/MLSP.2014.6958892","DOIUrl":null,"url":null,"abstract":"Sparse coding is a method of expressing the input vector as a linear combination of a few vectors taken from a set of template vectors, often called a dictionary or codebook. A good dictionary is the one that sparse codes most vectors in a given class of possible input vectors. There are currently several proposals to learn a good dictionary from a set of input vectors. Such methods are termed under the title of dictionary learning. We propose a new dictionary learning algorithm, called K-normalized bilateral projections (K-NBP), which is a modification to a widely used dictionary learning method, i.e., K-singular value decomposition (K-SVD). The main idea behind this was to standardize and normalize the input matrix as a preprocessing stage, and to correspondingly normalize the estimated source vectors in the dictionary update stage. The experimental results revealed that our method was fast, and when the number of iterations was limited, it outperformed K-SVD. Also, if only a coarse approximation was needed, it provided results that were almost like those from K-SVD, but with fewer iterations. This indicated that our method was particularly suited to large data sets with many dimensions, where each iteration took a long time.","PeriodicalId":329167,"journal":{"name":"2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"41 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2014-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MLSP.2014.6958892","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
Sparse coding is a method of expressing the input vector as a linear combination of a few vectors taken from a set of template vectors, often called a dictionary or codebook. A good dictionary is the one that sparse codes most vectors in a given class of possible input vectors. There are currently several proposals to learn a good dictionary from a set of input vectors. Such methods are termed under the title of dictionary learning. We propose a new dictionary learning algorithm, called K-normalized bilateral projections (K-NBP), which is a modification to a widely used dictionary learning method, i.e., K-singular value decomposition (K-SVD). The main idea behind this was to standardize and normalize the input matrix as a preprocessing stage, and to correspondingly normalize the estimated source vectors in the dictionary update stage. The experimental results revealed that our method was fast, and when the number of iterations was limited, it outperformed K-SVD. Also, if only a coarse approximation was needed, it provided results that were almost like those from K-SVD, but with fewer iterations. This indicated that our method was particularly suited to large data sets with many dimensions, where each iteration took a long time.