{"title":"基于自适应光谱特征解耦与全局局部特征融合网络的高光谱图像分类","authors":"Yunji Zhao, Nailong Song, Wenming Bao","doi":"10.1007/s12145-024-01415-2","DOIUrl":null,"url":null,"abstract":"<p>Deep learning-based methods are widely used in hyperspectral image (HSI) classification and have achieved excellent classification performance. However, hyperspectral data from different categories exhibit strong nonlinear coupling, which results in low spatial distinguishability between samples from different categories. Under the condition of limited sample size, how to extract spectral-spatial features and reduce the coupling of hyperspectral data from different categories is the key to achieving high-precision classification. Some methods based on Convolutional Neural Networks (CNN) tend to focus on local information within hyperspectral cubes. Transformers have excellent performance in modeling global dependencies between sequences. To solve the above problems, this paper proposes a global local feature fusion network (GLF2Net) for hyperspectral classification. To effectively integrate global information, this method introduces frequency domain statistical methods into the field of hyperspectral image classification. Firstly, this paper utilizes Fast Fourier Transform (FFT) to obtain frequency domain information from HSI data. Then, an improved adaptive 13-dimensional frequency domain statistical feature is applied as a supplement to the information after Principal Component Analysis (PCA) dimensionality reduction. To fully capture local-global hyperspectral features from HSI data, a dual-branch structure with a Transformer encoder Convolution Mixer Branch (TCM) and a CNN Branch is designed. Through extensive experiments on real HSI datasets, it is proven that the classification performance of GLF2Net is superior to several classic HSI classification methods.</p>","PeriodicalId":49318,"journal":{"name":"Earth Science Informatics","volume":"39 1","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Hyperspectral image classification based on adaptive spectral feature decoupling with global local feature fusion network\",\"authors\":\"Yunji Zhao, Nailong Song, Wenming Bao\",\"doi\":\"10.1007/s12145-024-01415-2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Deep learning-based methods are widely used in hyperspectral image (HSI) classification and have achieved excellent classification performance. However, hyperspectral data from different categories exhibit strong nonlinear coupling, which results in low spatial distinguishability between samples from different categories. Under the condition of limited sample size, how to extract spectral-spatial features and reduce the coupling of hyperspectral data from different categories is the key to achieving high-precision classification. Some methods based on Convolutional Neural Networks (CNN) tend to focus on local information within hyperspectral cubes. Transformers have excellent performance in modeling global dependencies between sequences. To solve the above problems, this paper proposes a global local feature fusion network (GLF2Net) for hyperspectral classification. To effectively integrate global information, this method introduces frequency domain statistical methods into the field of hyperspectral image classification. Firstly, this paper utilizes Fast Fourier Transform (FFT) to obtain frequency domain information from HSI data. Then, an improved adaptive 13-dimensional frequency domain statistical feature is applied as a supplement to the information after Principal Component Analysis (PCA) dimensionality reduction. To fully capture local-global hyperspectral features from HSI data, a dual-branch structure with a Transformer encoder Convolution Mixer Branch (TCM) and a CNN Branch is designed. Through extensive experiments on real HSI datasets, it is proven that the classification performance of GLF2Net is superior to several classic HSI classification methods.</p>\",\"PeriodicalId\":49318,\"journal\":{\"name\":\"Earth Science Informatics\",\"volume\":\"39 1\",\"pages\":\"\"},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2024-07-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Earth Science Informatics\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://doi.org/10.1007/s12145-024-01415-2\",\"RegionNum\":4,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Earth Science Informatics","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1007/s12145-024-01415-2","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Hyperspectral image classification based on adaptive spectral feature decoupling with global local feature fusion network
Deep learning-based methods are widely used in hyperspectral image (HSI) classification and have achieved excellent classification performance. However, hyperspectral data from different categories exhibit strong nonlinear coupling, which results in low spatial distinguishability between samples from different categories. Under the condition of limited sample size, how to extract spectral-spatial features and reduce the coupling of hyperspectral data from different categories is the key to achieving high-precision classification. Some methods based on Convolutional Neural Networks (CNN) tend to focus on local information within hyperspectral cubes. Transformers have excellent performance in modeling global dependencies between sequences. To solve the above problems, this paper proposes a global local feature fusion network (GLF2Net) for hyperspectral classification. To effectively integrate global information, this method introduces frequency domain statistical methods into the field of hyperspectral image classification. Firstly, this paper utilizes Fast Fourier Transform (FFT) to obtain frequency domain information from HSI data. Then, an improved adaptive 13-dimensional frequency domain statistical feature is applied as a supplement to the information after Principal Component Analysis (PCA) dimensionality reduction. To fully capture local-global hyperspectral features from HSI data, a dual-branch structure with a Transformer encoder Convolution Mixer Branch (TCM) and a CNN Branch is designed. Through extensive experiments on real HSI datasets, it is proven that the classification performance of GLF2Net is superior to several classic HSI classification methods.
期刊介绍:
The Earth Science Informatics [ESIN] journal aims at rapid publication of high-quality, current, cutting-edge, and provocative scientific work in the area of Earth Science Informatics as it relates to Earth systems science and space science. This includes articles on the application of formal and computational methods, computational Earth science, spatial and temporal analyses, and all aspects of computer applications to the acquisition, storage, processing, interchange, and visualization of data and information about the materials, properties, processes, features, and phenomena that occur at all scales and locations in the Earth system’s five components (atmosphere, hydrosphere, geosphere, biosphere, cryosphere) and in space (see "About this journal" for more detail). The quarterly journal publishes research, methodology, and software articles, as well as editorials, comments, and book and software reviews. Review articles of relevant findings, topics, and methodologies are also considered.