AIR-CNN:用于处理桶形失真问题的轻量级自动图像校正 CNN

IF 2.7 3区 工程技术 Q1 ENGINEERING, MULTIDISCIPLINARY
Can Zhou, Can Zhou, Hongqiu Zhu, Tianhao Liu
{"title":"AIR-CNN:用于处理桶形失真问题的轻量级自动图像校正 CNN","authors":"Can Zhou, Can Zhou, Hongqiu Zhu, Tianhao Liu","doi":"10.1088/1361-6501/ad1979","DOIUrl":null,"url":null,"abstract":"Barrel distortions often exist in images captured by wide-angle lenses, and the presence of barrel distortions reduces the label-making accuracy of algorithms and the precision rate of final target detection and semantic recognition. To reduce the interference of barrel distortions on imaging, we have proposed a lightweight image rectification network AIR-CNN for barrel distortion. The network is based on a parameter sharing (PS) convolutional neural network structure, which is trained on the distorted image dataset to predict the pixel displacement field between the distorted image and the rectified image, and finally restores the rectified image based on the predicted pixel displacement field. The experimental results show that the AIR-CNN can greatly reduce the number of network parameters through the parameter sharing mechanism and implicitly learns the texture features by asymmetric convolution (AC) kernels to obtain higher rectification accuracy at a lower computational cost, and automatically obtain the distortion parameters of the camera without special calibration methods. The AIR-CNN outperforms previous image rectification methods in both intuitive and quantitative comparisons (EPE, PSNR, NRMSE, SSIM).","PeriodicalId":18526,"journal":{"name":"Measurement Science and Technology","volume":"19 4","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2023-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AIR-CNN: A Lightweight Automatic Image Rectification CNN Used for Barrel Distortion\",\"authors\":\"Can Zhou, Can Zhou, Hongqiu Zhu, Tianhao Liu\",\"doi\":\"10.1088/1361-6501/ad1979\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Barrel distortions often exist in images captured by wide-angle lenses, and the presence of barrel distortions reduces the label-making accuracy of algorithms and the precision rate of final target detection and semantic recognition. To reduce the interference of barrel distortions on imaging, we have proposed a lightweight image rectification network AIR-CNN for barrel distortion. The network is based on a parameter sharing (PS) convolutional neural network structure, which is trained on the distorted image dataset to predict the pixel displacement field between the distorted image and the rectified image, and finally restores the rectified image based on the predicted pixel displacement field. The experimental results show that the AIR-CNN can greatly reduce the number of network parameters through the parameter sharing mechanism and implicitly learns the texture features by asymmetric convolution (AC) kernels to obtain higher rectification accuracy at a lower computational cost, and automatically obtain the distortion parameters of the camera without special calibration methods. The AIR-CNN outperforms previous image rectification methods in both intuitive and quantitative comparisons (EPE, PSNR, NRMSE, SSIM).\",\"PeriodicalId\":18526,\"journal\":{\"name\":\"Measurement Science and Technology\",\"volume\":\"19 4\",\"pages\":\"\"},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2023-12-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Measurement Science and Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1088/1361-6501/ad1979\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Measurement Science and Technology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1361-6501/ad1979","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

广角镜头拍摄的图像往往存在桶状畸变,桶状畸变的存在会降低算法的标签制作精度,降低最终目标检测和语义识别的精确率。为了减少桶状畸变对成像的干扰,我们提出了一种针对桶状畸变的轻量级图像矫正网络 AIR-CNN。该网络基于参数共享(PS)卷积神经网络结构,通过对畸变图像数据集进行训练,预测畸变图像与矫正图像之间的像素位移场,最后根据预测的像素位移场还原矫正图像。实验结果表明,AIR-CNN 可通过参数共享机制大大减少网络参数数量,并通过非对称卷积(AC)核隐式学习纹理特征,从而以较低的计算成本获得更高的矫正精度,并且无需特殊的校准方法即可自动获得摄像机的畸变参数。在直观和定量比较(EPE、PSNR、NRMSE、SSIM)方面,AIR-CNN 都优于之前的图像校正方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
AIR-CNN: A Lightweight Automatic Image Rectification CNN Used for Barrel Distortion
Barrel distortions often exist in images captured by wide-angle lenses, and the presence of barrel distortions reduces the label-making accuracy of algorithms and the precision rate of final target detection and semantic recognition. To reduce the interference of barrel distortions on imaging, we have proposed a lightweight image rectification network AIR-CNN for barrel distortion. The network is based on a parameter sharing (PS) convolutional neural network structure, which is trained on the distorted image dataset to predict the pixel displacement field between the distorted image and the rectified image, and finally restores the rectified image based on the predicted pixel displacement field. The experimental results show that the AIR-CNN can greatly reduce the number of network parameters through the parameter sharing mechanism and implicitly learns the texture features by asymmetric convolution (AC) kernels to obtain higher rectification accuracy at a lower computational cost, and automatically obtain the distortion parameters of the camera without special calibration methods. The AIR-CNN outperforms previous image rectification methods in both intuitive and quantitative comparisons (EPE, PSNR, NRMSE, SSIM).
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Measurement Science and Technology
Measurement Science and Technology 工程技术-工程:综合
CiteScore
4.30
自引率
16.70%
发文量
656
审稿时长
4.9 months
期刊介绍: Measurement Science and Technology publishes articles on new measurement techniques and associated instrumentation. Papers that describe experiments must represent an advance in measurement science or measurement technique rather than the application of established experimental technique. Bearing in mind the multidisciplinary nature of the journal, authors must provide an introduction to their work that makes clear the novelty, significance, broader relevance of their work in a measurement context and relevance to the readership of Measurement Science and Technology. All submitted articles should contain consideration of the uncertainty, precision and/or accuracy of the measurements presented. Subject coverage includes the theory, practice and application of measurement in physics, chemistry, engineering and the environmental and life sciences from inception to commercial exploitation. Publications in the journal should emphasize the novelty of reported methods, characterize them and demonstrate their performance using examples or applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信