用于单幅图像去模糊的au形傅立叶单元变压器

Hongmei Zhang, Yongde Guo
{"title":"用于单幅图像去模糊的au形傅立叶单元变压器","authors":"Hongmei Zhang, Yongde Guo","doi":"10.1109/CISCE58541.2023.10142927","DOIUrl":null,"url":null,"abstract":"There are many causes of image blurring, including optical, atmospheric, artificial and technical factors, etc. It is important to deblur images in daily production life. To achieve better results, different methods are needed to deal with different causes of blurring. From the technical aspect, blurred image processing methods are divided into three main categories, namely image enhancement, image restoration and super-resolution reconstruction. Overall, although blurred image processing algorithms have achieved a very wide range of applications, but image algorithms have their own limitations after all, we can not pin all problems on the image algorithm, for different kinds of blurred problems, to be treated differently. For blurring or image quality degradation caused by lens out of focus, dust obscuring, line aging, camera failure, etc., with the help of video diagnostic system, must be repaired in time to solve the problem at the source. For low light and other priority to choose day and night type high-sensitivity cameras, for rain and fog, motion and pre-sampling caused by image quality degradation, you can use the “video enhancement server” contains a variety of blur image processing algorithms to improve image quality. The purpose of single-image deblurring is to restore blurry images to sharp images and recover the texture detail features of the image. The Transformer model is able to capture the correlation of the blurry pixels over long distances, which has significant performance on image deblurring tasks, but its computational complexity grows quadratically with increasing spatial resolution. In addition, some methods use convolution to reduce image resolution, but it leads to information loss. In this paper, we propose an effective Transformer model, named Fourier Unit Transformer (FUformer), based on Fourier transform constructing the shallow features extraction module and the self-attention module, which can reduce computational complexity and fuse image local and global features to recover image texture details. Experimental results show that the proposed method performs well on the deblurring task. Code will be available at https://github.com/zox-iii/FUformer.","PeriodicalId":145263,"journal":{"name":"2023 5th International Conference on Communications, Information System and Computer Engineering (CISCE)","volume":"151 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AU-Shaped Fourier Unit Transformer for Single Image Deblurring\",\"authors\":\"Hongmei Zhang, Yongde Guo\",\"doi\":\"10.1109/CISCE58541.2023.10142927\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"There are many causes of image blurring, including optical, atmospheric, artificial and technical factors, etc. It is important to deblur images in daily production life. To achieve better results, different methods are needed to deal with different causes of blurring. From the technical aspect, blurred image processing methods are divided into three main categories, namely image enhancement, image restoration and super-resolution reconstruction. Overall, although blurred image processing algorithms have achieved a very wide range of applications, but image algorithms have their own limitations after all, we can not pin all problems on the image algorithm, for different kinds of blurred problems, to be treated differently. For blurring or image quality degradation caused by lens out of focus, dust obscuring, line aging, camera failure, etc., with the help of video diagnostic system, must be repaired in time to solve the problem at the source. For low light and other priority to choose day and night type high-sensitivity cameras, for rain and fog, motion and pre-sampling caused by image quality degradation, you can use the “video enhancement server” contains a variety of blur image processing algorithms to improve image quality. The purpose of single-image deblurring is to restore blurry images to sharp images and recover the texture detail features of the image. The Transformer model is able to capture the correlation of the blurry pixels over long distances, which has significant performance on image deblurring tasks, but its computational complexity grows quadratically with increasing spatial resolution. In addition, some methods use convolution to reduce image resolution, but it leads to information loss. In this paper, we propose an effective Transformer model, named Fourier Unit Transformer (FUformer), based on Fourier transform constructing the shallow features extraction module and the self-attention module, which can reduce computational complexity and fuse image local and global features to recover image texture details. Experimental results show that the proposed method performs well on the deblurring task. Code will be available at https://github.com/zox-iii/FUformer.\",\"PeriodicalId\":145263,\"journal\":{\"name\":\"2023 5th International Conference on Communications, Information System and Computer Engineering (CISCE)\",\"volume\":\"151 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 5th International Conference on Communications, Information System and Computer Engineering (CISCE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CISCE58541.2023.10142927\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 5th International Conference on Communications, Information System and Computer Engineering (CISCE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CISCE58541.2023.10142927","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

造成图像模糊的原因有很多,包括光学、大气、人为和技术等因素。在日常生产生活中,图像去模糊是非常重要的。为了达到更好的效果,需要不同的方法来处理不同的模糊原因。从技术上讲,模糊图像处理方法主要分为图像增强、图像恢复和超分辨率重建三大类。总的来说,虽然模糊图像处理算法已经取得了非常广泛的应用,但是图像算法也有其自身的局限性,毕竟我们不能把所有的问题都钉在图像算法上,对于不同种类的模糊问题,要区别对待。对于因镜头失焦、粉尘遮挡、线路老化、摄像机故障等引起的模糊或图像质量下降,必须借助视频诊断系统,及时进行修复,从源头上解决问题。对于弱光等优先选择昼、夜型高灵敏度相机,对于雨雾、运动和预采样造成的图像质量下降,可以使用“视频增强服务器”中包含的多种模糊图像处理算法来提高图像质量。单幅图像去模糊的目的是将模糊的图像恢复为清晰的图像,恢复图像的纹理细节特征。Transformer模型能够捕获远距离模糊像素的相关性,在图像去模糊任务中具有显著的性能,但其计算复杂度随着空间分辨率的增加呈二次增长。此外,有些方法使用卷积来降低图像分辨率,但会导致信息丢失。本文提出了一种基于傅里叶变换构造浅特征提取模块和自关注模块的有效变压器模型——傅里叶单元变压器(FUformer),该模型可以降低计算复杂度,融合图像局部和全局特征以恢复图像纹理细节。实验结果表明,该方法能较好地完成图像去模糊任务。代码将在https://github.com/zox-iii/FUformer上提供。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
AU-Shaped Fourier Unit Transformer for Single Image Deblurring
There are many causes of image blurring, including optical, atmospheric, artificial and technical factors, etc. It is important to deblur images in daily production life. To achieve better results, different methods are needed to deal with different causes of blurring. From the technical aspect, blurred image processing methods are divided into three main categories, namely image enhancement, image restoration and super-resolution reconstruction. Overall, although blurred image processing algorithms have achieved a very wide range of applications, but image algorithms have their own limitations after all, we can not pin all problems on the image algorithm, for different kinds of blurred problems, to be treated differently. For blurring or image quality degradation caused by lens out of focus, dust obscuring, line aging, camera failure, etc., with the help of video diagnostic system, must be repaired in time to solve the problem at the source. For low light and other priority to choose day and night type high-sensitivity cameras, for rain and fog, motion and pre-sampling caused by image quality degradation, you can use the “video enhancement server” contains a variety of blur image processing algorithms to improve image quality. The purpose of single-image deblurring is to restore blurry images to sharp images and recover the texture detail features of the image. The Transformer model is able to capture the correlation of the blurry pixels over long distances, which has significant performance on image deblurring tasks, but its computational complexity grows quadratically with increasing spatial resolution. In addition, some methods use convolution to reduce image resolution, but it leads to information loss. In this paper, we propose an effective Transformer model, named Fourier Unit Transformer (FUformer), based on Fourier transform constructing the shallow features extraction module and the self-attention module, which can reduce computational complexity and fuse image local and global features to recover image texture details. Experimental results show that the proposed method performs well on the deblurring task. Code will be available at https://github.com/zox-iii/FUformer.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信