基于gan的人脸图像去噪与复原技术的性能研究

Turhan Kimbrough, Pu Tian, Weixian Liao, Wei Yu
{"title":"基于gan的人脸图像去噪与复原技术的性能研究","authors":"Turhan Kimbrough, Pu Tian, Weixian Liao, Wei Yu","doi":"10.1109/SERA57763.2023.10197680","DOIUrl":null,"url":null,"abstract":"Facial recognition (FR) systems are employed to identify and authenticate individuals. There has been a rise in privacy concerns regarding mass surveillance and unauthorized usages. As a result, one viable approach is adding adversarial noise to distort user profile images so that FR technology can be bypassed. Nonetheless, such approaches could be used by adversaries to avoid detection in surveillance footage and therefore evade identification. To combat this threat, a line of research efforts focuses on generative adversarial network (GAN)-based Denoising and Restoration to remove adversarial noise. In this paper, GAN-based methods are investigated experimentally for assessing their effectiveness. Particularly, three GAN-based approaches, i.e., Blind Face Restoration, Blur and Restore, and Image-to-image Translation, are extensively examined with several representative classification approaches. Our evaluation results show that GAN denoising schemes could improve image visual quality, but are ineffective to remove perturbations for privacy protection attached by Fawkes or Lowkey. We further discuss some future research directions on image transformation-based approaches, which can potentially improve the effectiveness.","PeriodicalId":211080,"journal":{"name":"2023 IEEE/ACIS 21st International Conference on Software Engineering Research, Management and Applications (SERA)","volume":"48 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Performance of GAN-Based Denoising and Restoration Techniques for Adversarial Face Images\",\"authors\":\"Turhan Kimbrough, Pu Tian, Weixian Liao, Wei Yu\",\"doi\":\"10.1109/SERA57763.2023.10197680\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Facial recognition (FR) systems are employed to identify and authenticate individuals. There has been a rise in privacy concerns regarding mass surveillance and unauthorized usages. As a result, one viable approach is adding adversarial noise to distort user profile images so that FR technology can be bypassed. Nonetheless, such approaches could be used by adversaries to avoid detection in surveillance footage and therefore evade identification. To combat this threat, a line of research efforts focuses on generative adversarial network (GAN)-based Denoising and Restoration to remove adversarial noise. In this paper, GAN-based methods are investigated experimentally for assessing their effectiveness. Particularly, three GAN-based approaches, i.e., Blind Face Restoration, Blur and Restore, and Image-to-image Translation, are extensively examined with several representative classification approaches. Our evaluation results show that GAN denoising schemes could improve image visual quality, but are ineffective to remove perturbations for privacy protection attached by Fawkes or Lowkey. We further discuss some future research directions on image transformation-based approaches, which can potentially improve the effectiveness.\",\"PeriodicalId\":211080,\"journal\":{\"name\":\"2023 IEEE/ACIS 21st International Conference on Software Engineering Research, Management and Applications (SERA)\",\"volume\":\"48 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE/ACIS 21st International Conference on Software Engineering Research, Management and Applications (SERA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SERA57763.2023.10197680\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE/ACIS 21st International Conference on Software Engineering Research, Management and Applications (SERA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SERA57763.2023.10197680","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

人脸识别(FR)系统用于识别和验证个人。对大规模监控和未经授权使用的隐私担忧有所上升。因此,一种可行的方法是添加对抗性噪声来扭曲用户个人资料图像,从而可以绕过FR技术。尽管如此,这种方法可能会被对手用来避开监控录像的检测,从而逃避识别。为了对抗这种威胁,一系列的研究工作集中在基于生成对抗网络(GAN)的去噪和恢复上,以消除对抗噪声。本文对基于氮化镓的方法进行了实验研究,以评估其有效性。特别是,三种基于gan的方法,即盲脸恢复,模糊和恢复,以及图像到图像的翻译,用几种代表性的分类方法进行了广泛的研究。我们的评估结果表明,GAN去噪方案可以改善图像的视觉质量,但对于去除fox或Lowkey附加的隐私保护扰动无效。我们进一步讨论了未来基于图像变换方法的一些研究方向,这些方法可能会提高有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Performance of GAN-Based Denoising and Restoration Techniques for Adversarial Face Images
Facial recognition (FR) systems are employed to identify and authenticate individuals. There has been a rise in privacy concerns regarding mass surveillance and unauthorized usages. As a result, one viable approach is adding adversarial noise to distort user profile images so that FR technology can be bypassed. Nonetheless, such approaches could be used by adversaries to avoid detection in surveillance footage and therefore evade identification. To combat this threat, a line of research efforts focuses on generative adversarial network (GAN)-based Denoising and Restoration to remove adversarial noise. In this paper, GAN-based methods are investigated experimentally for assessing their effectiveness. Particularly, three GAN-based approaches, i.e., Blind Face Restoration, Blur and Restore, and Image-to-image Translation, are extensively examined with several representative classification approaches. Our evaluation results show that GAN denoising schemes could improve image visual quality, but are ineffective to remove perturbations for privacy protection attached by Fawkes or Lowkey. We further discuss some future research directions on image transformation-based approaches, which can potentially improve the effectiveness.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信