Romrawin Chumpu, Pitchayagan Temniranrat, S. Marukatat
{"title":"Synthetic face generation from in-the-wild face components swapping","authors":"Romrawin Chumpu, Pitchayagan Temniranrat, S. Marukatat","doi":"10.1109/iSAI-NLP56921.2022.9960274","DOIUrl":null,"url":null,"abstract":"Facial identification has recently been a legal con-cern for protecting one's identity and personal confidentiality. Many face synthesis techniques were used to safeguard individual users' data. This work presents a technique for generating synthetic faces from in-the-wild face components. The face components, such as the eyes, eyebrows, nose, and mouth, were extracted from a facial landmark of in-the-wild images and ran-domly replaced with the original image. Generative Adversarial Networks (GANs) for face restoration were then used to denoise the swapped image while preserving the original colorization. The experiments on face swapping with ten thousand of wild images demonstrate an average of 0.723 difference from the source image. The result shows that our face component swapping technique could be an effective lawful way to use facial data in the future.","PeriodicalId":399019,"journal":{"name":"2022 17th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 17th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/iSAI-NLP56921.2022.9960274","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
Facial identification has recently been a legal con-cern for protecting one's identity and personal confidentiality. Many face synthesis techniques were used to safeguard individual users' data. This work presents a technique for generating synthetic faces from in-the-wild face components. The face components, such as the eyes, eyebrows, nose, and mouth, were extracted from a facial landmark of in-the-wild images and ran-domly replaced with the original image. Generative Adversarial Networks (GANs) for face restoration were then used to denoise the swapped image while preserving the original colorization. The experiments on face swapping with ten thousand of wild images demonstrate an average of 0.723 difference from the source image. The result shows that our face component swapping technique could be an effective lawful way to use facial data in the future.