{"title":"图像配准的深度学习方法概述,重点介绍基于特征的方法","authors":"Kavitha Kuppala, Sandhya Banda, Thirumala Rao Barige","doi":"10.1080/19479832.2019.1707720","DOIUrl":null,"url":null,"abstract":"ABSTRACT Image registration is an essential pre-processing step for several computer vision problems like image reconstruction and image fusion. In this paper, we present a review on image registration approaches using deep learning. The focus of the survey presented is on how conventional image registration methods such as area-based and feature-based methods are addressed using deep net architectures. Registration approach adopted depends on type of images and type of transformation used to describe the deformation between the images in an application. We then present a comparative performance analysis of convolutional neural networks that have shown good performance across feature extraction, matching and transformation estimation in featured-based registration. Experimentation is done on each of these approaches using a dataset of aerial images generated by inducing deformations such as scale.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"11 1","pages":"113 - 135"},"PeriodicalIF":1.8000,"publicationDate":"2020-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/19479832.2019.1707720","citationCount":"26","resultStr":"{\"title\":\"An overview of deep learning methods for image registration with focus on feature-based approaches\",\"authors\":\"Kavitha Kuppala, Sandhya Banda, Thirumala Rao Barige\",\"doi\":\"10.1080/19479832.2019.1707720\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Image registration is an essential pre-processing step for several computer vision problems like image reconstruction and image fusion. In this paper, we present a review on image registration approaches using deep learning. The focus of the survey presented is on how conventional image registration methods such as area-based and feature-based methods are addressed using deep net architectures. Registration approach adopted depends on type of images and type of transformation used to describe the deformation between the images in an application. We then present a comparative performance analysis of convolutional neural networks that have shown good performance across feature extraction, matching and transformation estimation in featured-based registration. Experimentation is done on each of these approaches using a dataset of aerial images generated by inducing deformations such as scale.\",\"PeriodicalId\":46012,\"journal\":{\"name\":\"International Journal of Image and Data Fusion\",\"volume\":\"11 1\",\"pages\":\"113 - 135\"},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2020-01-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://sci-hub-pdf.com/10.1080/19479832.2019.1707720\",\"citationCount\":\"26\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Image and Data Fusion\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/19479832.2019.1707720\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Image and Data Fusion","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/19479832.2019.1707720","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"REMOTE SENSING","Score":null,"Total":0}
An overview of deep learning methods for image registration with focus on feature-based approaches
ABSTRACT Image registration is an essential pre-processing step for several computer vision problems like image reconstruction and image fusion. In this paper, we present a review on image registration approaches using deep learning. The focus of the survey presented is on how conventional image registration methods such as area-based and feature-based methods are addressed using deep net architectures. Registration approach adopted depends on type of images and type of transformation used to describe the deformation between the images in an application. We then present a comparative performance analysis of convolutional neural networks that have shown good performance across feature extraction, matching and transformation estimation in featured-based registration. Experimentation is done on each of these approaches using a dataset of aerial images generated by inducing deformations such as scale.
期刊介绍:
International Journal of Image and Data Fusion provides a single source of information for all aspects of image and data fusion methodologies, developments, techniques and applications. Image and data fusion techniques are important for combining the many sources of satellite, airborne and ground based imaging systems, and integrating these with other related data sets for enhanced information extraction and decision making. Image and data fusion aims at the integration of multi-sensor, multi-temporal, multi-resolution and multi-platform image data, together with geospatial data, GIS, in-situ, and other statistical data sets for improved information extraction, as well as to increase the reliability of the information. This leads to more accurate information that provides for robust operational performance, i.e. increased confidence, reduced ambiguity and improved classification enabling evidence based management. The journal welcomes original research papers, review papers, shorter letters, technical articles, book reviews and conference reports in all areas of image and data fusion including, but not limited to, the following aspects and topics: • Automatic registration/geometric aspects of fusing images with different spatial, spectral, temporal resolutions; phase information; or acquired in different modes • Pixel, feature and decision level fusion algorithms and methodologies • Data Assimilation: fusing data with models • Multi-source classification and information extraction • Integration of satellite, airborne and terrestrial sensor systems • Fusing temporal data sets for change detection studies (e.g. for Land Cover/Land Use Change studies) • Image and data mining from multi-platform, multi-source, multi-scale, multi-temporal data sets (e.g. geometric information, topological information, statistical information, etc.).