Masked GANs for Face Completion: A Novel Deep Learning Approach

Q2 Computer Science
Anshuman Sharma, Biswaroop Nath, Tejaswini Kar, D. Khasim
{"title":"Masked GANs for Face Completion: A Novel Deep Learning Approach","authors":"Anshuman Sharma, Biswaroop Nath, Tejaswini Kar, D. Khasim","doi":"10.4108/eetpht.9.4850","DOIUrl":null,"url":null,"abstract":"INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work is to remove mask objects in facial images. In this study, authors propose a novel approach for face completion using Generative Adversarial Networks (GANs) that utilize masked data. This technology can help in image restoration and preservation, thus enabling us to cherish those memories that are held dear to our hearts.OBJECTIVES: Train a GAN to learn the mapping from incomplete to complete face images by utilizing a masked input image.METHODS: The discriminator is trained to distinguish between face images and full ground truth images. Our results indicate that our technique generates high-quality, realistic facial images that are visually comparable to the ground truth and that it can generalise to new faces that were not encountered during training.RESULTS: Our findings indicate that GANs with masked inputs are a good approach for generating whole face images from partial or masked data.CONCLUSION: Our experimental findings show that our method produces facial images of great quality and realism that are visually equivalent to the actual thing. Our proposed approach can also be applied to fresh faces that weren’t seen. The performance can still be improved further using larger dataset. Also, further investigation into adversial attacks may help in improving performance. This technology can be further utilized for developing realtime mask removal software as well.","PeriodicalId":36936,"journal":{"name":"EAI Endorsed Transactions on Pervasive Health and Technology","volume":"14 2","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"EAI Endorsed Transactions on Pervasive Health and Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4108/eetpht.9.4850","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 0

Abstract

INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work is to remove mask objects in facial images. In this study, authors propose a novel approach for face completion using Generative Adversarial Networks (GANs) that utilize masked data. This technology can help in image restoration and preservation, thus enabling us to cherish those memories that are held dear to our hearts.OBJECTIVES: Train a GAN to learn the mapping from incomplete to complete face images by utilizing a masked input image.METHODS: The discriminator is trained to distinguish between face images and full ground truth images. Our results indicate that our technique generates high-quality, realistic facial images that are visually comparable to the ground truth and that it can generalise to new faces that were not encountered during training.RESULTS: Our findings indicate that GANs with masked inputs are a good approach for generating whole face images from partial or masked data.CONCLUSION: Our experimental findings show that our method produces facial images of great quality and realism that are visually equivalent to the actual thing. Our proposed approach can also be applied to fresh faces that weren’t seen. The performance can still be improved further using larger dataset. Also, further investigation into adversial attacks may help in improving performance. This technology can be further utilized for developing realtime mask removal software as well.
用于人脸补全的屏蔽 GAN:一种新颖的深度学习方法
简介:最近基于深度学习的图像编辑方法在移除图像中的物体方面取得了可喜的成果,但在移除性质复杂的大型物体,尤其是面部图像中的遮罩物方面,却未能产生可观的性能。为此,这项工作的目标是去除面部图像中的遮罩对象。在这项研究中,作者提出了一种利用生成对抗网络(GANs)来完成人脸补全的新方法。这项技术有助于图像修复和保存,从而让我们能够珍惜那些珍藏在心底的记忆:方法:训练判别器以区分人脸图像和完整的地面实况图像。结果:我们的研究结果表明,利用遮挡输入的 GANs 是一种从部分或遮挡数据生成完整人脸图像的好方法。结论:我们的实验结果表明,我们的方法生成的人脸图像质量高、逼真,在视觉上与实物相当。我们提出的方法还可用于未见过的新鲜人脸。使用更大的数据集还能进一步提高性能。此外,进一步研究对抗性攻击也有助于提高性能。这项技术还可进一步用于开发实时面具去除软件。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
EAI Endorsed Transactions on Pervasive Health and Technology
EAI Endorsed Transactions on Pervasive Health and Technology Computer Science-Computer Science (miscellaneous)
CiteScore
3.50
自引率
0.00%
发文量
14
审稿时长
10 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信