使用注意力增强的3D-2D卷积自编码器进行矿物制图的深度高光谱聚类

IF 4.5 Q2 ENVIRONMENTAL SCIENCES
Sima Peyghambari, Yun Zhang
{"title":"使用注意力增强的3D-2D卷积自编码器进行矿物制图的深度高光谱聚类","authors":"Sima Peyghambari,&nbsp;Yun Zhang","doi":"10.1016/j.rsase.2025.101700","DOIUrl":null,"url":null,"abstract":"<div><div>Remotely sensed hyperspectral images (HSIs) provide valuable compositional information on the surface target materials crucial for Earth observation and geoscience applications. The necessity of labelled data and the high dimensionality of HSI hinder efficient hyperspectral data processing. Hyperspectral data clustering can help to address this challenge. Conventional clustering approaches mainly use shallow spectral absorption features. Deep-learning-based methods, such as autoencoder models, can extract deep HSI's spectral and spatial features. However, the most commonly used 3D-convolutional autoencoder (3D-CAE) models have several disadvantages, including intensive computational costs and the potential to lose spatial information. To avoid losing important information and reduce computational costs, this research proposes an attention-enhanced hybrid 3D-2D-CAE spectral-spatial model for clustering HSIs in mineral mapping. The proposed model enables the capture of non-linear relationships between data points in an unsupervised manner. The network utilizes spectral and spatial attention layers in the 3D and 2D convolutions to capture spectral and spatial information, reducing spectral complexities and enhancing spatial features. The captured feature representations are fed to an agglomerative Gaussian mixture model (AGMM) to cluster HSI. Experimenting with different autoencoder-based clustering methods and comparing their results with those of conventional clustering algorithms, the proposed model achieved an overall accuracy of 88.14 %. It consistently demonstrated the superior performance of the hybrid attention-enhanced 3D-2D-CAE-based clustering method, reinforcing its potential for accurate mineral mapping. Furthermore, the less computationally expensive, attention-enhanced 3D-2D-CAE structure outperforms the extensive GPU usage and processing time of the 3D-CAE method.</div></div>","PeriodicalId":53227,"journal":{"name":"Remote Sensing Applications-Society and Environment","volume":"39 ","pages":"Article 101700"},"PeriodicalIF":4.5000,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep hyperspectral clustering using attention-enhanced 3D-2D convolutional autoencoder for mineral mapping\",\"authors\":\"Sima Peyghambari,&nbsp;Yun Zhang\",\"doi\":\"10.1016/j.rsase.2025.101700\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Remotely sensed hyperspectral images (HSIs) provide valuable compositional information on the surface target materials crucial for Earth observation and geoscience applications. The necessity of labelled data and the high dimensionality of HSI hinder efficient hyperspectral data processing. Hyperspectral data clustering can help to address this challenge. Conventional clustering approaches mainly use shallow spectral absorption features. Deep-learning-based methods, such as autoencoder models, can extract deep HSI's spectral and spatial features. However, the most commonly used 3D-convolutional autoencoder (3D-CAE) models have several disadvantages, including intensive computational costs and the potential to lose spatial information. To avoid losing important information and reduce computational costs, this research proposes an attention-enhanced hybrid 3D-2D-CAE spectral-spatial model for clustering HSIs in mineral mapping. The proposed model enables the capture of non-linear relationships between data points in an unsupervised manner. The network utilizes spectral and spatial attention layers in the 3D and 2D convolutions to capture spectral and spatial information, reducing spectral complexities and enhancing spatial features. The captured feature representations are fed to an agglomerative Gaussian mixture model (AGMM) to cluster HSI. Experimenting with different autoencoder-based clustering methods and comparing their results with those of conventional clustering algorithms, the proposed model achieved an overall accuracy of 88.14 %. It consistently demonstrated the superior performance of the hybrid attention-enhanced 3D-2D-CAE-based clustering method, reinforcing its potential for accurate mineral mapping. Furthermore, the less computationally expensive, attention-enhanced 3D-2D-CAE structure outperforms the extensive GPU usage and processing time of the 3D-CAE method.</div></div>\",\"PeriodicalId\":53227,\"journal\":{\"name\":\"Remote Sensing Applications-Society and Environment\",\"volume\":\"39 \",\"pages\":\"Article 101700\"},\"PeriodicalIF\":4.5000,\"publicationDate\":\"2025-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Remote Sensing Applications-Society and Environment\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2352938525002538\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENVIRONMENTAL SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Remote Sensing Applications-Society and Environment","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352938525002538","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

遥感高光谱图像(hsi)提供了有价值的地表目标物质组成信息,对地球观测和地球科学应用至关重要。标记数据的必要性和高光谱指数的高维性阻碍了高效的高光谱数据处理。高光谱数据聚类可以帮助解决这一挑战。传统的聚类方法主要利用浅光谱吸收特征。基于深度学习的方法,如自动编码器模型,可以提取深度HSI的光谱和空间特征。然而,最常用的3d -卷积自编码器(3D-CAE)模型有几个缺点,包括密集的计算成本和可能丢失空间信息。为了避免丢失重要信息并降低计算成本,本研究提出了一种注意力增强的混合3D-2D-CAE光谱-空间模型,用于矿物填图中hsi的聚类。提出的模型能够以无监督的方式捕获数据点之间的非线性关系。该网络利用三维和二维卷积中的光谱和空间注意层捕获光谱和空间信息,降低光谱复杂性,增强空间特征。将捕获的特征表示馈送到聚集高斯混合模型(AGMM)以聚类HSI。实验了不同的基于自编码器的聚类方法,并将其结果与传统聚类算法进行了比较,该模型的总体准确率达到了88.14%。它始终证明了基于混合注意力增强的3d - 2d - ca聚类方法的优越性能,增强了其精确矿物制图的潜力。此外,计算成本更低,注意力增强的3D-2D-CAE结构优于3D-CAE方法的大量GPU使用和处理时间。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep hyperspectral clustering using attention-enhanced 3D-2D convolutional autoencoder for mineral mapping
Remotely sensed hyperspectral images (HSIs) provide valuable compositional information on the surface target materials crucial for Earth observation and geoscience applications. The necessity of labelled data and the high dimensionality of HSI hinder efficient hyperspectral data processing. Hyperspectral data clustering can help to address this challenge. Conventional clustering approaches mainly use shallow spectral absorption features. Deep-learning-based methods, such as autoencoder models, can extract deep HSI's spectral and spatial features. However, the most commonly used 3D-convolutional autoencoder (3D-CAE) models have several disadvantages, including intensive computational costs and the potential to lose spatial information. To avoid losing important information and reduce computational costs, this research proposes an attention-enhanced hybrid 3D-2D-CAE spectral-spatial model for clustering HSIs in mineral mapping. The proposed model enables the capture of non-linear relationships between data points in an unsupervised manner. The network utilizes spectral and spatial attention layers in the 3D and 2D convolutions to capture spectral and spatial information, reducing spectral complexities and enhancing spatial features. The captured feature representations are fed to an agglomerative Gaussian mixture model (AGMM) to cluster HSI. Experimenting with different autoencoder-based clustering methods and comparing their results with those of conventional clustering algorithms, the proposed model achieved an overall accuracy of 88.14 %. It consistently demonstrated the superior performance of the hybrid attention-enhanced 3D-2D-CAE-based clustering method, reinforcing its potential for accurate mineral mapping. Furthermore, the less computationally expensive, attention-enhanced 3D-2D-CAE structure outperforms the extensive GPU usage and processing time of the 3D-CAE method.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
8.00
自引率
8.50%
发文量
204
审稿时长
65 days
期刊介绍: The journal ''Remote Sensing Applications: Society and Environment'' (RSASE) focuses on remote sensing studies that address specific topics with an emphasis on environmental and societal issues - regional / local studies with global significance. Subjects are encouraged to have an interdisciplinary approach and include, but are not limited by: " -Global and climate change studies addressing the impact of increasing concentrations of greenhouse gases, CO2 emission, carbon balance and carbon mitigation, energy system on social and environmental systems -Ecological and environmental issues including biodiversity, ecosystem dynamics, land degradation, atmospheric and water pollution, urban footprint, ecosystem management and natural hazards (e.g. earthquakes, typhoons, floods, landslides) -Natural resource studies including land-use in general, biomass estimation, forests, agricultural land, plantation, soils, coral reefs, wetland and water resources -Agriculture, food production systems and food security outcomes -Socio-economic issues including urban systems, urban growth, public health, epidemics, land-use transition and land use conflicts -Oceanography and coastal zone studies, including sea level rise projections, coastlines changes and the ocean-land interface -Regional challenges for remote sensing application techniques, monitoring and analysis, such as cloud screening and atmospheric correction for tropical regions -Interdisciplinary studies combining remote sensing, household survey data, field measurements and models to address environmental, societal and sustainability issues -Quantitative and qualitative analysis that documents the impact of using remote sensing studies in social, political, environmental or economic systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信