Object Classification Using Support Vector Machines with Kernel-based Data Preprocessing

Abstract The paper explores possibility of improving Support Vector Machine-based classification performance by introducing an input data dimensionality reduction step. Feature extraction by means of two different kernel methods are considered: kernel Principal Component Analysis (kPCA) and Supervised kernel Principal Component Analysis. It is hypothesized that input domain transformation, aimed at emphasizing between-class differences, would facilitate classification problem. Experiments, performed on three different datasets show that one can benefit from the proposed approach, as it provides lower variability in classification performance at similar, high recognition rates.