CASSNet: Cross-Attention Enhanced Spectral–Spatial Interaction Network for Hyperspectral Image Super-Resolution

Abstract

Deep-learning-based super-resolution (SR) methods for a single hyperspectral image have made significant progress in recent years and become an important research direction in remote sensing. Existing methods perform well in extracting spatial features, but challenges remain in integrating spectral and spatial features when modeling global relationships. In order to take full advantage of the higher spectral resolution of hyperspectral images, this article proposes a novel hyperspectral image SR method (CASSNet), which integrates convolutional neural networks and cross-attention mechanisms into a unified framework. This approach achieves comprehensive integration of spectral and spatial information, with extensive exploration at both local and global levels. In the local feature extraction stage, parallel 3-D/2-D convolutions work in tandem to efficiently capture detail information from both spectral and spatial dimensions. In addition, a spectral–spatial dual-branch module employing the cross-attention mechanism is designed to capture the global dependencies within the features, where the reconstructed spectral–spatial module and the spectral–spatial interaction unit can effectively promote the interaction and complementarity of spectral–spatial features. The experiments on three publicly available datasets demonstrated that the proposed method obtained superior SR results, outperforming state-of-the-art SR algorithms.