Yameng Hong , Chengcai Leng , Beihua Liu , Jinye Peng , Irene Cheng , Anup Basu
{"title":"多模态遥感图像配准的块信息策略","authors":"Yameng Hong , Chengcai Leng , Beihua Liu , Jinye Peng , Irene Cheng , Anup Basu","doi":"10.1016/j.engappai.2025.111236","DOIUrl":null,"url":null,"abstract":"<div><div>Registration of multi-modal remote sensing image pairs (MRSI) is challenging given the distinct imaging mechanisms of multi-modal data sources, which lead to substantial geometric and radiometric distortions and inaccuracies in correspondences. To tackle this issue, we propose a novel approach that integrates local image information into feature representations through the design of local regions and the extraction of local information. The latter comprises of two key components: rank-based feature redistribution and residual information extraction utilizing a pyramid-like structure of local patches. This enhanced feature representation technique, termed Reinforced Local Information of LSS (RLILSS), embeds local information to improve the performance of the Local Self-Similarity (LSS)-based framework for MRSI registration. RLILSS strengthens feature characterization across various regions and addresses the limitations of supplementary information. This enables more reliable correspondences between images. Experimental results show that the proposed method achieves higher accuracy and better registration across diverse multi-modal datasets. Detailed analyses confirm its superiority over state-of-the-art methods in both accuracy and robustness. This approach holds significant potential for applications in automatic geographic registration and disaster area reconstruction.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"157 ","pages":"Article 111236"},"PeriodicalIF":8.0000,"publicationDate":"2025-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Block information strategy for multi-modal remote sensing image registration\",\"authors\":\"Yameng Hong , Chengcai Leng , Beihua Liu , Jinye Peng , Irene Cheng , Anup Basu\",\"doi\":\"10.1016/j.engappai.2025.111236\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Registration of multi-modal remote sensing image pairs (MRSI) is challenging given the distinct imaging mechanisms of multi-modal data sources, which lead to substantial geometric and radiometric distortions and inaccuracies in correspondences. To tackle this issue, we propose a novel approach that integrates local image information into feature representations through the design of local regions and the extraction of local information. The latter comprises of two key components: rank-based feature redistribution and residual information extraction utilizing a pyramid-like structure of local patches. This enhanced feature representation technique, termed Reinforced Local Information of LSS (RLILSS), embeds local information to improve the performance of the Local Self-Similarity (LSS)-based framework for MRSI registration. RLILSS strengthens feature characterization across various regions and addresses the limitations of supplementary information. This enables more reliable correspondences between images. Experimental results show that the proposed method achieves higher accuracy and better registration across diverse multi-modal datasets. Detailed analyses confirm its superiority over state-of-the-art methods in both accuracy and robustness. This approach holds significant potential for applications in automatic geographic registration and disaster area reconstruction.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"157 \",\"pages\":\"Article 111236\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-06-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625012370\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625012370","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Block information strategy for multi-modal remote sensing image registration
Registration of multi-modal remote sensing image pairs (MRSI) is challenging given the distinct imaging mechanisms of multi-modal data sources, which lead to substantial geometric and radiometric distortions and inaccuracies in correspondences. To tackle this issue, we propose a novel approach that integrates local image information into feature representations through the design of local regions and the extraction of local information. The latter comprises of two key components: rank-based feature redistribution and residual information extraction utilizing a pyramid-like structure of local patches. This enhanced feature representation technique, termed Reinforced Local Information of LSS (RLILSS), embeds local information to improve the performance of the Local Self-Similarity (LSS)-based framework for MRSI registration. RLILSS strengthens feature characterization across various regions and addresses the limitations of supplementary information. This enables more reliable correspondences between images. Experimental results show that the proposed method achieves higher accuracy and better registration across diverse multi-modal datasets. Detailed analyses confirm its superiority over state-of-the-art methods in both accuracy and robustness. This approach holds significant potential for applications in automatic geographic registration and disaster area reconstruction.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.