{"title":"用于离焦模糊估算的多重交互式增强技术","authors":"Huaguang Li;Wenhua Qian;Jinde Cao;Rencan Nie;Peng Liu;Dan Xu","doi":"10.1109/TCI.2024.3354427","DOIUrl":null,"url":null,"abstract":"Defocus blur estimation requires high-precision detection between the homogeneous region and transition edge. This paper develops a novel progressive design that effectively addresses this challenge. Our multi-interactive scheme could gradually learn the characteristics of degraded input and divide complex defocus blur estimation into more manageable subnetworks. Specifically, we equally degrade the source inputs and combine them with complementary information subnetworks. In the first two stages, feature interactive modules are introduced to achieve the purpose of information interaction between different features. One challenge in multi-stage networks is transmitting information features between stages, which led to the development of the supervision-guided attention module. Taking into consideration the intricacies associated with neural network design and the pronounced affinity of defocus and focus characteristics with global semantic information, in the final stage, we opt to directly input the original image, after significant affinity-based feature weighting, into the network. This strategic incorporation of global semantic information serves to mitigate the challenges posed by feature concatenation artifacts and noise encountered in the preceding two stages, thereby bolstering the accuracy of the model.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"10 ","pages":"640-652"},"PeriodicalIF":4.2000,"publicationDate":"2024-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-Interactive Enhanced for Defocus Blur Estimation\",\"authors\":\"Huaguang Li;Wenhua Qian;Jinde Cao;Rencan Nie;Peng Liu;Dan Xu\",\"doi\":\"10.1109/TCI.2024.3354427\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Defocus blur estimation requires high-precision detection between the homogeneous region and transition edge. This paper develops a novel progressive design that effectively addresses this challenge. Our multi-interactive scheme could gradually learn the characteristics of degraded input and divide complex defocus blur estimation into more manageable subnetworks. Specifically, we equally degrade the source inputs and combine them with complementary information subnetworks. In the first two stages, feature interactive modules are introduced to achieve the purpose of information interaction between different features. One challenge in multi-stage networks is transmitting information features between stages, which led to the development of the supervision-guided attention module. Taking into consideration the intricacies associated with neural network design and the pronounced affinity of defocus and focus characteristics with global semantic information, in the final stage, we opt to directly input the original image, after significant affinity-based feature weighting, into the network. This strategic incorporation of global semantic information serves to mitigate the challenges posed by feature concatenation artifacts and noise encountered in the preceding two stages, thereby bolstering the accuracy of the model.\",\"PeriodicalId\":56022,\"journal\":{\"name\":\"IEEE Transactions on Computational Imaging\",\"volume\":\"10 \",\"pages\":\"640-652\"},\"PeriodicalIF\":4.2000,\"publicationDate\":\"2024-03-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Computational Imaging\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10483260/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10483260/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Multi-Interactive Enhanced for Defocus Blur Estimation
Defocus blur estimation requires high-precision detection between the homogeneous region and transition edge. This paper develops a novel progressive design that effectively addresses this challenge. Our multi-interactive scheme could gradually learn the characteristics of degraded input and divide complex defocus blur estimation into more manageable subnetworks. Specifically, we equally degrade the source inputs and combine them with complementary information subnetworks. In the first two stages, feature interactive modules are introduced to achieve the purpose of information interaction between different features. One challenge in multi-stage networks is transmitting information features between stages, which led to the development of the supervision-guided attention module. Taking into consideration the intricacies associated with neural network design and the pronounced affinity of defocus and focus characteristics with global semantic information, in the final stage, we opt to directly input the original image, after significant affinity-based feature weighting, into the network. This strategic incorporation of global semantic information serves to mitigate the challenges posed by feature concatenation artifacts and noise encountered in the preceding two stages, thereby bolstering the accuracy of the model.
期刊介绍:
The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.