Three-Dimension Spatial–Spectral Attention Transformer for Hyperspectral Image Denoising

Abstract

Hyperspectral image (HSI) denoising is a crucial step for its subsequent applications. In this article, we propose TDSAT, a 3-D spatial-spectral attention Transformer model designed to effectively remove noise in HSI processing while preserving essential spectral and spatial information. The primary objective of this model is to utilize the 3-D Transformer to explore the global spectral-spatial features in HSI, learn the relationships among different bands, and preserve high-quality spectral and spatial information for denoising. The proposed method consists of three main components: the multihead spectral attention (MHSA) module, the gated-dconv feedforward network (GDFN) module, and the spectral enhancement (SpeE) module. The MHSA module learns the relationships among different bands and emphasizes the local spatial information. The GDFN module explores more expressive and discriminative spectral features. The SpeE module enhances the perception of subtle differences between different spectrums. Moreover, unlike the previous Transformer denoising method that can only handle fixed bands, the proposed method combines 3-D convolution and spectral-spatial attention Transformer blocks, enabling the denoising of HSI with an arbitrary number of bands. Experimental results demonstrate that TDSAT outperforms compared methods. The code is available at https://github.com/ Featherrain/TDSAT.