Restricted Boltzmann Machine as Image Pre-processing Method for Deep Neural Classifier

Abstract

The paper presents a novel approach to image preprocessing for feature extraction that is designed for reduction of dimensionality of the classifier which is in this case the convolutional neural network (CNN). The proposed method uses Restricted Boltzmann Machine(RBM) as an Aggregation Method (AM) for binary feature descriptors. The assumption of this technique is that the RBM is performing an dimension expansion of the feature space. Also the type of the data undergoes the transformation from binary to floating point. The conventional approach in convolutional neural networks uses as an input the image that consists of one (grayscale) or three channels (RGB). The method presented herein allows to have the number of channels configurable, as it depends on the size of the Restricted Boltzmann Machine (RBM). The size of the entire network and its parallel implementation makes the architecture usable in real-time systems with reduced memory size.