Hyperspectral Image Classification Based on Fusing S3-PCA, 2D-SSA and Random Patch Network

Abstract

Recently, the rapid development of deep learning has greatly improved the performance of image classification. However, a central problem in hyperspectral image (HSI) classification is spectral uncertainty, where spectral features alone cannot accurately and robustly identify a pixel point in a hyperspectral image. This paper presents a novel HSI classification network called MS-RPNet, i.e., multiscale superpixelwise RPNet, which combines superpixel-based S3-PCA with two-dimensional singular spectrum analysis (2D-SSA) based on the Random Patches Network (RPNet). The proposed frame can not only take advantage of the data-driven method, but can also apply S3-PCA to efficiently consider more global and local spectral knowledge at the super-pixel level. Meanwhile, 2D-SSA is used for noise removal and spatial feature extraction. Then, the final features are obtained by random patch convolution and other steps according to the cascade structure of RPNet. The layered extraction superimposes the different sparial information into multi-scale spatial features, which complements the features of various land covers. Finally, the final fusion features are classified by SVM to obtain the final classification results. The experimental results in several HSI datasets demonstrate the effectiveness and efficiency of MS-RPNet, which outperforms several current state-of-the-art methods.