Analysis of sparse PCA using high dimensional data

Abstract

In this study the Sparse Principal Component Analysis (PCA) has been chosen as feature extraction and further compared with the conventional PCA technique with six UCI Machine Learning high dimensionality data as database. Results attained showed that both PCA and Sparse PCA techniques are indeed suitable as feature extraction for high dimensional data since the accuracy rate attained are higher as compared to the original data as inputs to the classifier. However, the inconsistency in determining the number of PCs to be retained is ascertained and this is the drawback of PCA technique despite its greater accuracy rate. Meanwhile, the Sparse PCA retained the original number of principal components (PCs) with sparse loadings that are mainly zero but do not produce promising result with all the datasets. The Sparse PCA technique needs to be applied to suitable high dimensional dataset to gain its fullness accuracy and efficiency.