结合特征融合和注意机制的人脸图像恢复

Jiangtao Liu, Yan Wei, Jinzhi Deng
{"title":"结合特征融合和注意机制的人脸图像恢复","authors":"Jiangtao Liu, Yan Wei, Jinzhi Deng","doi":"10.1117/12.2671240","DOIUrl":null,"url":null,"abstract":"We propose a face image restoration method that combines feature fusion and attention mechanisms for the current image restoration field that generates blurred images, artifacts, inconsistent texture and structure fusion. The model divides image restoration into two stages. First, the edge information repaired by the edge generation adversarial network is used as the prior knowledge of the image, and then the generated prior knowledge and the broken image are put into the image repair network to generate the complete image. We introduce a texture-structure feature fusion method in the generator structure to solve the texture and structure fusion inconsistency problem and use a dense residual layer-hopping connection to mitigate the gradient disappearance problem while speeding up the model convergence and introduce a spatial and channel attention mechanism to generate correct semantic connections to enhance the model performance and suppress image blurring. We apply the algorithm to the CelebA-HQ face dataset, and compared with the current mainstream restoration algorithms, quantitative analysis shows that the method in this paper outperforms in three metrics, PSNR, SSIM, and L1.","PeriodicalId":227528,"journal":{"name":"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Combining feature fusion and attention mechanism for face image restoration\",\"authors\":\"Jiangtao Liu, Yan Wei, Jinzhi Deng\",\"doi\":\"10.1117/12.2671240\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We propose a face image restoration method that combines feature fusion and attention mechanisms for the current image restoration field that generates blurred images, artifacts, inconsistent texture and structure fusion. The model divides image restoration into two stages. First, the edge information repaired by the edge generation adversarial network is used as the prior knowledge of the image, and then the generated prior knowledge and the broken image are put into the image repair network to generate the complete image. We introduce a texture-structure feature fusion method in the generator structure to solve the texture and structure fusion inconsistency problem and use a dense residual layer-hopping connection to mitigate the gradient disappearance problem while speeding up the model convergence and introduce a spatial and channel attention mechanism to generate correct semantic connections to enhance the model performance and suppress image blurring. We apply the algorithm to the CelebA-HQ face dataset, and compared with the current mainstream restoration algorithms, quantitative analysis shows that the method in this paper outperforms in three metrics, PSNR, SSIM, and L1.\",\"PeriodicalId\":227528,\"journal\":{\"name\":\"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2671240\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2671240","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

针对当前图像恢复领域存在的图像模糊、伪影、纹理不一致和结构融合等问题,提出了一种特征融合和注意机制相结合的人脸图像恢复方法。该模型将图像恢复分为两个阶段。首先将边缘生成对抗网络修复的边缘信息作为图像的先验知识,然后将生成的先验知识和破碎图像放入图像修复网络中生成完整图像。在生成器结构中引入纹理-结构特征融合方法来解决纹理和结构融合不一致问题;在加速模型收敛的同时,采用密集残差跳层连接来缓解梯度消失问题;引入空间和通道注意机制来生成正确的语义连接,以提高模型性能,抑制图像模糊。将该算法应用于CelebA-HQ人脸数据集,与当前主流恢复算法相比,定量分析表明,本文方法在PSNR、SSIM和L1三个指标上都优于现有算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Combining feature fusion and attention mechanism for face image restoration
We propose a face image restoration method that combines feature fusion and attention mechanisms for the current image restoration field that generates blurred images, artifacts, inconsistent texture and structure fusion. The model divides image restoration into two stages. First, the edge information repaired by the edge generation adversarial network is used as the prior knowledge of the image, and then the generated prior knowledge and the broken image are put into the image repair network to generate the complete image. We introduce a texture-structure feature fusion method in the generator structure to solve the texture and structure fusion inconsistency problem and use a dense residual layer-hopping connection to mitigate the gradient disappearance problem while speeding up the model convergence and introduce a spatial and channel attention mechanism to generate correct semantic connections to enhance the model performance and suppress image blurring. We apply the algorithm to the CelebA-HQ face dataset, and compared with the current mainstream restoration algorithms, quantitative analysis shows that the method in this paper outperforms in three metrics, PSNR, SSIM, and L1.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信