基于深度学习特征匹配的灾区遥感图像配准

Qiang Chen, Fei Song, Xianyuan Liu, Sanxing Zhang, Tao Lei, Ping Jiang
{"title":"基于深度学习特征匹配的灾区遥感图像配准","authors":"Qiang Chen, Fei Song, Xianyuan Liu, Sanxing Zhang, Tao Lei, Ping Jiang","doi":"10.1117/12.2673374","DOIUrl":null,"url":null,"abstract":"With the rapid development of remote sensing technology, remote sensing registration plays an important role in the assessment of various natural disasters, especially earthquakes. However, multi-temporal remote sensing images for the assessment have some characteristics, e.g. large-scale and rotation, resulting in challenges of remote sensing registration. In order to better register remote sensing images, we propose a new image registration method with a deep learning feature matching strategy. We first extract the pre-match point sets M and S by using SIFT-FLANN (SIFT-Fast Library for Approximate Nearest Neighbors). Second, we filter out the correct matching point pairs from M and S by using a multiscale neighborhood information network and a dual-path ConvNeXt network with self-attention-guided local information enhancement. Thirdly, we register multi-temporal remote sensing images by solve the model parameters of the spatial transformation. Finally, we evaluate our proposed method using a variety of remote sensing images with different phases, including visible light images with different illumination, scale and geometry changes. On the remote sensing image dataset containing images of pre- and post-earthquake, we compare our method to existing state-of-the-art methods and provide the results with the evaluation indexes such as Root Mean Square Error (RMSE). The results show that our method for multi-temporal remote sensing registration has a higher registration accuracy and more robustness.","PeriodicalId":176918,"journal":{"name":"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Remote sensing image registration of disaster-affected areas based on deep learning feature matching\",\"authors\":\"Qiang Chen, Fei Song, Xianyuan Liu, Sanxing Zhang, Tao Lei, Ping Jiang\",\"doi\":\"10.1117/12.2673374\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the rapid development of remote sensing technology, remote sensing registration plays an important role in the assessment of various natural disasters, especially earthquakes. However, multi-temporal remote sensing images for the assessment have some characteristics, e.g. large-scale and rotation, resulting in challenges of remote sensing registration. In order to better register remote sensing images, we propose a new image registration method with a deep learning feature matching strategy. We first extract the pre-match point sets M and S by using SIFT-FLANN (SIFT-Fast Library for Approximate Nearest Neighbors). Second, we filter out the correct matching point pairs from M and S by using a multiscale neighborhood information network and a dual-path ConvNeXt network with self-attention-guided local information enhancement. Thirdly, we register multi-temporal remote sensing images by solve the model parameters of the spatial transformation. Finally, we evaluate our proposed method using a variety of remote sensing images with different phases, including visible light images with different illumination, scale and geometry changes. On the remote sensing image dataset containing images of pre- and post-earthquake, we compare our method to existing state-of-the-art methods and provide the results with the evaluation indexes such as Root Mean Square Error (RMSE). The results show that our method for multi-temporal remote sensing registration has a higher registration accuracy and more robustness.\",\"PeriodicalId\":176918,\"journal\":{\"name\":\"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)\",\"volume\":\"24 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2673374\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2673374","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

随着遥感技术的飞速发展,遥感配准在各种自然灾害尤其是地震灾害的评估中发挥着重要作用。然而,用于评估的多时相遥感图像具有大尺度和旋转等特点,这给遥感配准带来了挑战。为了更好地配准遥感图像,提出了一种基于深度学习特征匹配策略的图像配准方法。我们首先使用SIFT-FLANN (SIFT-Fast Library for Approximate Nearest Neighbors)提取预匹配点集M和S。其次,利用多尺度邻域信息网络和自注意引导局部信息增强的双路径ConvNeXt网络,从M和S中过滤出正确的匹配点对;第三,通过求解空间变换模型参数对多时相遥感图像进行配准。最后,我们使用不同相位的遥感图像(包括不同照度、尺度和几何变化的可见光图像)来评估我们的方法。在包含地震前后影像的遥感影像数据集上,我们将该方法与现有最先进的方法进行了比较,并提供了均方根误差(RMSE)等评价指标。结果表明,该方法具有较高的配准精度和鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Remote sensing image registration of disaster-affected areas based on deep learning feature matching
With the rapid development of remote sensing technology, remote sensing registration plays an important role in the assessment of various natural disasters, especially earthquakes. However, multi-temporal remote sensing images for the assessment have some characteristics, e.g. large-scale and rotation, resulting in challenges of remote sensing registration. In order to better register remote sensing images, we propose a new image registration method with a deep learning feature matching strategy. We first extract the pre-match point sets M and S by using SIFT-FLANN (SIFT-Fast Library for Approximate Nearest Neighbors). Second, we filter out the correct matching point pairs from M and S by using a multiscale neighborhood information network and a dual-path ConvNeXt network with self-attention-guided local information enhancement. Thirdly, we register multi-temporal remote sensing images by solve the model parameters of the spatial transformation. Finally, we evaluate our proposed method using a variety of remote sensing images with different phases, including visible light images with different illumination, scale and geometry changes. On the remote sensing image dataset containing images of pre- and post-earthquake, we compare our method to existing state-of-the-art methods and provide the results with the evaluation indexes such as Root Mean Square Error (RMSE). The results show that our method for multi-temporal remote sensing registration has a higher registration accuracy and more robustness.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信