Semantic Face Image Inpainting based on Generative Adversarial Network

Heshu Zhang, Tao Li
{"title":"Semantic Face Image Inpainting based on Generative Adversarial Network","authors":"Heshu Zhang, Tao Li","doi":"10.1109/YAC51587.2020.9337498","DOIUrl":null,"url":null,"abstract":"With the popularity of Internet technology and camera equipment, people are accustomed to using images and videos to record life. Image deletion is one of the most important degradation directions when image degradation occurs. The repair process of the digital image repair method is to use the information of the missing part of the image, according to certain repair rules to repair and fill the missing part of the image, so that the repaired image is complete and natural. At present, the existing image inpainting algorithms still have some shortcomings in visual effect and algorithm efficiency. In order to solve the problems of fuzzy details and poor visual perception of the existing technology in the implementation of face image inpainting results, as well as the problem that the whole model could not be controlled due to the mode collapse caused by the use of the generative adversarial network, this paper provides a semantic inpainting method of face image based on multi-scale feature fusion. Using suppression enhancement unit to suppress useless channels, enhance useful channels, acquire long-range and multi-level dependency interaction without increasing parameters, coordinate the details of each position and the details of the far end when repairing the image, expand the receptive field, make up for the lack of information when generating the missing image edge, balance the learning ability of generating network and discriminating network to improve the inpainting effect of missing face image.","PeriodicalId":287095,"journal":{"name":"2020 35th Youth Academic Annual Conference of Chinese Association of Automation (YAC)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 35th Youth Academic Annual Conference of Chinese Association of Automation (YAC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/YAC51587.2020.9337498","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

With the popularity of Internet technology and camera equipment, people are accustomed to using images and videos to record life. Image deletion is one of the most important degradation directions when image degradation occurs. The repair process of the digital image repair method is to use the information of the missing part of the image, according to certain repair rules to repair and fill the missing part of the image, so that the repaired image is complete and natural. At present, the existing image inpainting algorithms still have some shortcomings in visual effect and algorithm efficiency. In order to solve the problems of fuzzy details and poor visual perception of the existing technology in the implementation of face image inpainting results, as well as the problem that the whole model could not be controlled due to the mode collapse caused by the use of the generative adversarial network, this paper provides a semantic inpainting method of face image based on multi-scale feature fusion. Using suppression enhancement unit to suppress useless channels, enhance useful channels, acquire long-range and multi-level dependency interaction without increasing parameters, coordinate the details of each position and the details of the far end when repairing the image, expand the receptive field, make up for the lack of information when generating the missing image edge, balance the learning ability of generating network and discriminating network to improve the inpainting effect of missing face image.
基于生成对抗网络的语义人脸图像修复
随着互联网技术和摄像设备的普及,人们习惯于用图像和视频来记录生活。图像删除是图像退化过程中最重要的退化方向之一。数字图像修复法的修复过程是利用图像缺失部分的信息,按照一定的修复规则对图像缺失部分进行修复和填充,使修复后的图像完整、自然。目前,现有的图像绘制算法在视觉效果和算法效率上还存在一些不足。为了解决现有技术在人脸图像补图结果实现中存在的细节模糊、视觉感知差等问题,以及使用生成式对抗网络造成的模式崩溃导致整体模型无法控制的问题,本文提出了一种基于多尺度特征融合的人脸图像语义补图方法。利用抑制增强单元抑制无用信道,增强有用信道,在不增加参数的情况下获得远距离、多层次的依赖交互,在修复图像时协调各位置细节与远端细节,扩大接收场,弥补生成缺失图像边缘时信息的不足;平衡生成网络和判别网络的学习能力,提高缺失人脸图像的修复效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信