A Comparative Study of Object Recognition Techniques: Softmax, Linear and Quadratic Discriminant Analysis Based on Convolutional Neural Network Feature Extraction

Abstract

This paper presents a comparison study on using softmax, linear discriminant analysis (LDA) and quadratic discriminant analysis (QDA) for object recognition. The least effort is needed for hyper-parameter tuning or selection for all such three classifiers. Convolutional neural network (CNN), using feed-forward-architecture deep learning neural network is employed here for efficient feature extraction and reduction. Then, the extracted, reduced features are fed into the classification comparison. The experiments rely on a small-image CIFAR-10 dataset such that a simple, four convolutional-layer CNN architecture can possibly handle effective feature extraction with hardly over-fitting. Recognition performance evaluations rely on averages of precision, recall, F1 scores and accuracy rates, based on 10-fold cross validation for bias reduction purpose. Such performance measures are implemented under balanced as well as unbalanced --class data, respectively referred to equal and uniform-random-sampling unequal --size class dataset. The results indicate a few bits of recognition performance differences regarding F1 scores as well as accuracy rates among the CNN-LDA, CNN-QDA and CNN-softmax, where the balanced-class and unbalanced-class are separately determined. However, the lowest and the highest of the largest wrong prediction cases are generated by CNN-QDA and CNN-softmax respectively for both balanced and unbalanced-class data.