Huiyu Ding, Renfeng Liu, Hai Xiao, Qiangguo Zeng, Jun Liu, Zhihui Wang, Yingying Peng, Huali Li
{"title":"TBSSF-Net:用于高光谱图像分类的三分支空间光谱融合网络。","authors":"Huiyu Ding, Renfeng Liu, Hai Xiao, Qiangguo Zeng, Jun Liu, Zhihui Wang, Yingying Peng, Huali Li","doi":"10.1364/OE.550150","DOIUrl":null,"url":null,"abstract":"<p><p>Hyperspectral images (HSI) have been extensively applied in a multitude of domains, due to their combined spatial and spectral characteristics along with a wealth of spectral bands. The ingenious combination of spatial and spectral information in HSI classification has remained a central research area for an extended period. In the classification process, it is essential to choose an expanded neighborhood window for learning. Nonetheless, employing an extensive window could lead to the problem of a lack of independence between the training dataset and the test dataset. Hence, this paper puts forward a three-branch spatial-spectral fusion network (TBSSF-Net) for HSI classification based on a smaller patch size. The network is composed of a spatial key details aggregation branch, a spatial semantic knowledge refinement branch, and a spectral band signal granularity branch. By employing the spatial branch, the network not only retains the key characteristics of details within the space but also captures the contextual relationships of global semantic information. The introduction of the spectral branch permits the combination of signal granularity at diverse levels, supplementing the performance of the spectral dimension. The TBSSF-Net has been validated for its superiority and effectiveness on four public HSI datasets. Additionally, it demonstrates significant classification performance across diverse amounts of training sets.</p>","PeriodicalId":19691,"journal":{"name":"Optics express","volume":"33 2","pages":"3466-3500"},"PeriodicalIF":3.3000,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"TBSSF-Net: three-branch spatial-spectral fusion network for hyperspectral image classification.\",\"authors\":\"Huiyu Ding, Renfeng Liu, Hai Xiao, Qiangguo Zeng, Jun Liu, Zhihui Wang, Yingying Peng, Huali Li\",\"doi\":\"10.1364/OE.550150\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Hyperspectral images (HSI) have been extensively applied in a multitude of domains, due to their combined spatial and spectral characteristics along with a wealth of spectral bands. The ingenious combination of spatial and spectral information in HSI classification has remained a central research area for an extended period. In the classification process, it is essential to choose an expanded neighborhood window for learning. Nonetheless, employing an extensive window could lead to the problem of a lack of independence between the training dataset and the test dataset. Hence, this paper puts forward a three-branch spatial-spectral fusion network (TBSSF-Net) for HSI classification based on a smaller patch size. The network is composed of a spatial key details aggregation branch, a spatial semantic knowledge refinement branch, and a spectral band signal granularity branch. By employing the spatial branch, the network not only retains the key characteristics of details within the space but also captures the contextual relationships of global semantic information. The introduction of the spectral branch permits the combination of signal granularity at diverse levels, supplementing the performance of the spectral dimension. The TBSSF-Net has been validated for its superiority and effectiveness on four public HSI datasets. Additionally, it demonstrates significant classification performance across diverse amounts of training sets.</p>\",\"PeriodicalId\":19691,\"journal\":{\"name\":\"Optics express\",\"volume\":\"33 2\",\"pages\":\"3466-3500\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2025-01-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics express\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://doi.org/10.1364/OE.550150\",\"RegionNum\":2,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics express","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.1364/OE.550150","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
TBSSF-Net: three-branch spatial-spectral fusion network for hyperspectral image classification.
Hyperspectral images (HSI) have been extensively applied in a multitude of domains, due to their combined spatial and spectral characteristics along with a wealth of spectral bands. The ingenious combination of spatial and spectral information in HSI classification has remained a central research area for an extended period. In the classification process, it is essential to choose an expanded neighborhood window for learning. Nonetheless, employing an extensive window could lead to the problem of a lack of independence between the training dataset and the test dataset. Hence, this paper puts forward a three-branch spatial-spectral fusion network (TBSSF-Net) for HSI classification based on a smaller patch size. The network is composed of a spatial key details aggregation branch, a spatial semantic knowledge refinement branch, and a spectral band signal granularity branch. By employing the spatial branch, the network not only retains the key characteristics of details within the space but also captures the contextual relationships of global semantic information. The introduction of the spectral branch permits the combination of signal granularity at diverse levels, supplementing the performance of the spectral dimension. The TBSSF-Net has been validated for its superiority and effectiveness on four public HSI datasets. Additionally, it demonstrates significant classification performance across diverse amounts of training sets.
期刊介绍:
Optics Express is the all-electronic, open access journal for optics providing rapid publication for peer-reviewed articles that emphasize scientific and technology innovations in all aspects of optics and photonics.