遥感图像的深度特征学习与分类

Zohaib Y Ahmad, Bushra Naz, Sara Ali, Zakir Shaikh, Bhavani Shankar
{"title":"遥感图像的深度特征学习与分类","authors":"Zohaib Y Ahmad, Bushra Naz, Sara Ali, Zakir Shaikh, Bhavani Shankar","doi":"10.32350/umtair.21.004","DOIUrl":null,"url":null,"abstract":"Hyperspectral imaging has been largely utilized in applications involving remote sensing to describe the composition of thousands of spectral bands in a single scene. Hyperspectral images (HSI) require an accurate training model for extracting the characteristics of scenes presented in an image. Image learning models involving spectral resolution present major challenges because of the complex nature of image frames. Several attempts have been made to address this complexity. Nevertheless, these models have failed to retain a deeper understanding of hyperspectral images. Since there are mixed pixels, limited training samples, and duplicate data, so the deep learning method solves the problem.In this method, spectral values (for every pixel) of the hyperspectral images are sequentially fed into spectral long-short-term memory (LSTM) through several routes to study the spectral features. Most of the existing state-of-the-art models are based on spectral-spatial frameworks. The added spatial features add more dimensions to hyperspectral images. However, these classification models do not take advantage of the sequential nature of these images. Due to the presence of mixed pixels, limited training samples, and redundant data, the utilization of deep learning techniques addresses the problems. This paper describes a method for the classification of hyperspectral images through spectral-spatial LSTM networks. For extracting the first principal constituent from such an image, principle component analysis (PCA) was used in spectral and spatial joint feature networks (SSJFN), as well as spectral and spatial individual extraction of the features via LSTM, to get the uniform end-to-end network. Furthermore, it was aimed to achieve the integration of all processes in a neural network by making a classifier to overcome the training error and backpropagation, which may lead to learning more features. During categorization, SoftMax classification considers the spatial and spectral characteristics of all the pixels independently to get two different outcomes. Afterwards, joint spectral-spatial results are gained by using the strategy of decision fusion. The classification accuracy improves by 2.69%, 1.53%, and 1.08% when compared to the rest of the state-of-art methods.","PeriodicalId":198719,"journal":{"name":"UMT Artificial Intelligence Review","volume":"18 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Feature Learning And Classification Of Remote Sensing Images\",\"authors\":\"Zohaib Y Ahmad, Bushra Naz, Sara Ali, Zakir Shaikh, Bhavani Shankar\",\"doi\":\"10.32350/umtair.21.004\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Hyperspectral imaging has been largely utilized in applications involving remote sensing to describe the composition of thousands of spectral bands in a single scene. Hyperspectral images (HSI) require an accurate training model for extracting the characteristics of scenes presented in an image. Image learning models involving spectral resolution present major challenges because of the complex nature of image frames. Several attempts have been made to address this complexity. Nevertheless, these models have failed to retain a deeper understanding of hyperspectral images. Since there are mixed pixels, limited training samples, and duplicate data, so the deep learning method solves the problem.In this method, spectral values (for every pixel) of the hyperspectral images are sequentially fed into spectral long-short-term memory (LSTM) through several routes to study the spectral features. Most of the existing state-of-the-art models are based on spectral-spatial frameworks. The added spatial features add more dimensions to hyperspectral images. However, these classification models do not take advantage of the sequential nature of these images. Due to the presence of mixed pixels, limited training samples, and redundant data, the utilization of deep learning techniques addresses the problems. This paper describes a method for the classification of hyperspectral images through spectral-spatial LSTM networks. For extracting the first principal constituent from such an image, principle component analysis (PCA) was used in spectral and spatial joint feature networks (SSJFN), as well as spectral and spatial individual extraction of the features via LSTM, to get the uniform end-to-end network. Furthermore, it was aimed to achieve the integration of all processes in a neural network by making a classifier to overcome the training error and backpropagation, which may lead to learning more features. During categorization, SoftMax classification considers the spatial and spectral characteristics of all the pixels independently to get two different outcomes. Afterwards, joint spectral-spatial results are gained by using the strategy of decision fusion. The classification accuracy improves by 2.69%, 1.53%, and 1.08% when compared to the rest of the state-of-art methods.\",\"PeriodicalId\":198719,\"journal\":{\"name\":\"UMT Artificial Intelligence Review\",\"volume\":\"18 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-03-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"UMT Artificial Intelligence Review\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.32350/umtair.21.004\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"UMT Artificial Intelligence Review","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.32350/umtair.21.004","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在遥感应用中,高光谱成像被广泛用于描述单个场景中数千个光谱带的组成。高光谱图像(HSI)需要精确的训练模型来提取图像中呈现的场景特征。由于图像帧的复杂性,涉及光谱分辨率的图像学习模型面临重大挑战。为了解决这种复杂性,已经进行了几次尝试。然而,这些模型未能保留对高光谱图像的更深层次的理解。由于存在混合像素、有限的训练样本和重复的数据,所以深度学习方法解决了这个问题。该方法通过多种途径将高光谱图像的光谱值(每像素)依次输入到光谱长短期记忆(LSTM)中,研究光谱特征。大多数现有的最先进的模型都是基于光谱空间框架的。增加的空间特征为高光谱图像增加了更多维度。然而,这些分类模型没有利用这些图像的顺序特性。由于存在混合像素,有限的训练样本和冗余数据,利用深度学习技术解决了这些问题。本文介绍了一种利用光谱空间LSTM网络对高光谱图像进行分类的方法。为了从该图像中提取第一主成分,在光谱和空间联合特征网络(SSJFN)中使用主成分分析(PCA),并通过LSTM对特征进行光谱和空间单独提取,得到均匀的端到端网络。此外,通过制作分类器来克服训练误差和反向传播,从而实现神经网络中所有过程的集成,从而可能学习到更多的特征。在分类过程中,SoftMax分类分别考虑所有像元的空间和光谱特征,从而得到两种不同的分类结果。然后,采用决策融合策略获得联合光谱-空间结果。与其他最先进的方法相比,分类准确率分别提高了2.69%、1.53%和1.08%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep Feature Learning And Classification Of Remote Sensing Images
Hyperspectral imaging has been largely utilized in applications involving remote sensing to describe the composition of thousands of spectral bands in a single scene. Hyperspectral images (HSI) require an accurate training model for extracting the characteristics of scenes presented in an image. Image learning models involving spectral resolution present major challenges because of the complex nature of image frames. Several attempts have been made to address this complexity. Nevertheless, these models have failed to retain a deeper understanding of hyperspectral images. Since there are mixed pixels, limited training samples, and duplicate data, so the deep learning method solves the problem.In this method, spectral values (for every pixel) of the hyperspectral images are sequentially fed into spectral long-short-term memory (LSTM) through several routes to study the spectral features. Most of the existing state-of-the-art models are based on spectral-spatial frameworks. The added spatial features add more dimensions to hyperspectral images. However, these classification models do not take advantage of the sequential nature of these images. Due to the presence of mixed pixels, limited training samples, and redundant data, the utilization of deep learning techniques addresses the problems. This paper describes a method for the classification of hyperspectral images through spectral-spatial LSTM networks. For extracting the first principal constituent from such an image, principle component analysis (PCA) was used in spectral and spatial joint feature networks (SSJFN), as well as spectral and spatial individual extraction of the features via LSTM, to get the uniform end-to-end network. Furthermore, it was aimed to achieve the integration of all processes in a neural network by making a classifier to overcome the training error and backpropagation, which may lead to learning more features. During categorization, SoftMax classification considers the spatial and spectral characteristics of all the pixels independently to get two different outcomes. Afterwards, joint spectral-spatial results are gained by using the strategy of decision fusion. The classification accuracy improves by 2.69%, 1.53%, and 1.08% when compared to the rest of the state-of-art methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信