{"title":"使用注意力增强的3D-2D卷积自编码器进行矿物制图的深度高光谱聚类","authors":"Sima Peyghambari, Yun Zhang","doi":"10.1016/j.rsase.2025.101700","DOIUrl":null,"url":null,"abstract":"<div><div>Remotely sensed hyperspectral images (HSIs) provide valuable compositional information on the surface target materials crucial for Earth observation and geoscience applications. The necessity of labelled data and the high dimensionality of HSI hinder efficient hyperspectral data processing. Hyperspectral data clustering can help to address this challenge. Conventional clustering approaches mainly use shallow spectral absorption features. Deep-learning-based methods, such as autoencoder models, can extract deep HSI's spectral and spatial features. However, the most commonly used 3D-convolutional autoencoder (3D-CAE) models have several disadvantages, including intensive computational costs and the potential to lose spatial information. To avoid losing important information and reduce computational costs, this research proposes an attention-enhanced hybrid 3D-2D-CAE spectral-spatial model for clustering HSIs in mineral mapping. The proposed model enables the capture of non-linear relationships between data points in an unsupervised manner. The network utilizes spectral and spatial attention layers in the 3D and 2D convolutions to capture spectral and spatial information, reducing spectral complexities and enhancing spatial features. The captured feature representations are fed to an agglomerative Gaussian mixture model (AGMM) to cluster HSI. Experimenting with different autoencoder-based clustering methods and comparing their results with those of conventional clustering algorithms, the proposed model achieved an overall accuracy of 88.14 %. It consistently demonstrated the superior performance of the hybrid attention-enhanced 3D-2D-CAE-based clustering method, reinforcing its potential for accurate mineral mapping. Furthermore, the less computationally expensive, attention-enhanced 3D-2D-CAE structure outperforms the extensive GPU usage and processing time of the 3D-CAE method.</div></div>","PeriodicalId":53227,"journal":{"name":"Remote Sensing Applications-Society and Environment","volume":"39 ","pages":"Article 101700"},"PeriodicalIF":4.5000,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep hyperspectral clustering using attention-enhanced 3D-2D convolutional autoencoder for mineral mapping\",\"authors\":\"Sima Peyghambari, Yun Zhang\",\"doi\":\"10.1016/j.rsase.2025.101700\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Remotely sensed hyperspectral images (HSIs) provide valuable compositional information on the surface target materials crucial for Earth observation and geoscience applications. The necessity of labelled data and the high dimensionality of HSI hinder efficient hyperspectral data processing. Hyperspectral data clustering can help to address this challenge. Conventional clustering approaches mainly use shallow spectral absorption features. Deep-learning-based methods, such as autoencoder models, can extract deep HSI's spectral and spatial features. However, the most commonly used 3D-convolutional autoencoder (3D-CAE) models have several disadvantages, including intensive computational costs and the potential to lose spatial information. To avoid losing important information and reduce computational costs, this research proposes an attention-enhanced hybrid 3D-2D-CAE spectral-spatial model for clustering HSIs in mineral mapping. The proposed model enables the capture of non-linear relationships between data points in an unsupervised manner. The network utilizes spectral and spatial attention layers in the 3D and 2D convolutions to capture spectral and spatial information, reducing spectral complexities and enhancing spatial features. The captured feature representations are fed to an agglomerative Gaussian mixture model (AGMM) to cluster HSI. Experimenting with different autoencoder-based clustering methods and comparing their results with those of conventional clustering algorithms, the proposed model achieved an overall accuracy of 88.14 %. It consistently demonstrated the superior performance of the hybrid attention-enhanced 3D-2D-CAE-based clustering method, reinforcing its potential for accurate mineral mapping. Furthermore, the less computationally expensive, attention-enhanced 3D-2D-CAE structure outperforms the extensive GPU usage and processing time of the 3D-CAE method.</div></div>\",\"PeriodicalId\":53227,\"journal\":{\"name\":\"Remote Sensing Applications-Society and Environment\",\"volume\":\"39 \",\"pages\":\"Article 101700\"},\"PeriodicalIF\":4.5000,\"publicationDate\":\"2025-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Remote Sensing Applications-Society and Environment\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2352938525002538\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENVIRONMENTAL SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Remote Sensing Applications-Society and Environment","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352938525002538","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
Deep hyperspectral clustering using attention-enhanced 3D-2D convolutional autoencoder for mineral mapping
Remotely sensed hyperspectral images (HSIs) provide valuable compositional information on the surface target materials crucial for Earth observation and geoscience applications. The necessity of labelled data and the high dimensionality of HSI hinder efficient hyperspectral data processing. Hyperspectral data clustering can help to address this challenge. Conventional clustering approaches mainly use shallow spectral absorption features. Deep-learning-based methods, such as autoencoder models, can extract deep HSI's spectral and spatial features. However, the most commonly used 3D-convolutional autoencoder (3D-CAE) models have several disadvantages, including intensive computational costs and the potential to lose spatial information. To avoid losing important information and reduce computational costs, this research proposes an attention-enhanced hybrid 3D-2D-CAE spectral-spatial model for clustering HSIs in mineral mapping. The proposed model enables the capture of non-linear relationships between data points in an unsupervised manner. The network utilizes spectral and spatial attention layers in the 3D and 2D convolutions to capture spectral and spatial information, reducing spectral complexities and enhancing spatial features. The captured feature representations are fed to an agglomerative Gaussian mixture model (AGMM) to cluster HSI. Experimenting with different autoencoder-based clustering methods and comparing their results with those of conventional clustering algorithms, the proposed model achieved an overall accuracy of 88.14 %. It consistently demonstrated the superior performance of the hybrid attention-enhanced 3D-2D-CAE-based clustering method, reinforcing its potential for accurate mineral mapping. Furthermore, the less computationally expensive, attention-enhanced 3D-2D-CAE structure outperforms the extensive GPU usage and processing time of the 3D-CAE method.
期刊介绍:
The journal ''Remote Sensing Applications: Society and Environment'' (RSASE) focuses on remote sensing studies that address specific topics with an emphasis on environmental and societal issues - regional / local studies with global significance. Subjects are encouraged to have an interdisciplinary approach and include, but are not limited by: " -Global and climate change studies addressing the impact of increasing concentrations of greenhouse gases, CO2 emission, carbon balance and carbon mitigation, energy system on social and environmental systems -Ecological and environmental issues including biodiversity, ecosystem dynamics, land degradation, atmospheric and water pollution, urban footprint, ecosystem management and natural hazards (e.g. earthquakes, typhoons, floods, landslides) -Natural resource studies including land-use in general, biomass estimation, forests, agricultural land, plantation, soils, coral reefs, wetland and water resources -Agriculture, food production systems and food security outcomes -Socio-economic issues including urban systems, urban growth, public health, epidemics, land-use transition and land use conflicts -Oceanography and coastal zone studies, including sea level rise projections, coastlines changes and the ocean-land interface -Regional challenges for remote sensing application techniques, monitoring and analysis, such as cloud screening and atmospheric correction for tropical regions -Interdisciplinary studies combining remote sensing, household survey data, field measurements and models to address environmental, societal and sustainability issues -Quantitative and qualitative analysis that documents the impact of using remote sensing studies in social, political, environmental or economic systems