{"title":"基于gan的人脸图像去噪与复原技术的性能研究","authors":"Turhan Kimbrough, Pu Tian, Weixian Liao, Wei Yu","doi":"10.1109/SERA57763.2023.10197680","DOIUrl":null,"url":null,"abstract":"Facial recognition (FR) systems are employed to identify and authenticate individuals. There has been a rise in privacy concerns regarding mass surveillance and unauthorized usages. As a result, one viable approach is adding adversarial noise to distort user profile images so that FR technology can be bypassed. Nonetheless, such approaches could be used by adversaries to avoid detection in surveillance footage and therefore evade identification. To combat this threat, a line of research efforts focuses on generative adversarial network (GAN)-based Denoising and Restoration to remove adversarial noise. In this paper, GAN-based methods are investigated experimentally for assessing their effectiveness. Particularly, three GAN-based approaches, i.e., Blind Face Restoration, Blur and Restore, and Image-to-image Translation, are extensively examined with several representative classification approaches. Our evaluation results show that GAN denoising schemes could improve image visual quality, but are ineffective to remove perturbations for privacy protection attached by Fawkes or Lowkey. We further discuss some future research directions on image transformation-based approaches, which can potentially improve the effectiveness.","PeriodicalId":211080,"journal":{"name":"2023 IEEE/ACIS 21st International Conference on Software Engineering Research, Management and Applications (SERA)","volume":"48 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Performance of GAN-Based Denoising and Restoration Techniques for Adversarial Face Images\",\"authors\":\"Turhan Kimbrough, Pu Tian, Weixian Liao, Wei Yu\",\"doi\":\"10.1109/SERA57763.2023.10197680\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Facial recognition (FR) systems are employed to identify and authenticate individuals. There has been a rise in privacy concerns regarding mass surveillance and unauthorized usages. As a result, one viable approach is adding adversarial noise to distort user profile images so that FR technology can be bypassed. Nonetheless, such approaches could be used by adversaries to avoid detection in surveillance footage and therefore evade identification. To combat this threat, a line of research efforts focuses on generative adversarial network (GAN)-based Denoising and Restoration to remove adversarial noise. In this paper, GAN-based methods are investigated experimentally for assessing their effectiveness. Particularly, three GAN-based approaches, i.e., Blind Face Restoration, Blur and Restore, and Image-to-image Translation, are extensively examined with several representative classification approaches. Our evaluation results show that GAN denoising schemes could improve image visual quality, but are ineffective to remove perturbations for privacy protection attached by Fawkes or Lowkey. We further discuss some future research directions on image transformation-based approaches, which can potentially improve the effectiveness.\",\"PeriodicalId\":211080,\"journal\":{\"name\":\"2023 IEEE/ACIS 21st International Conference on Software Engineering Research, Management and Applications (SERA)\",\"volume\":\"48 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE/ACIS 21st International Conference on Software Engineering Research, Management and Applications (SERA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SERA57763.2023.10197680\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE/ACIS 21st International Conference on Software Engineering Research, Management and Applications (SERA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SERA57763.2023.10197680","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Performance of GAN-Based Denoising and Restoration Techniques for Adversarial Face Images
Facial recognition (FR) systems are employed to identify and authenticate individuals. There has been a rise in privacy concerns regarding mass surveillance and unauthorized usages. As a result, one viable approach is adding adversarial noise to distort user profile images so that FR technology can be bypassed. Nonetheless, such approaches could be used by adversaries to avoid detection in surveillance footage and therefore evade identification. To combat this threat, a line of research efforts focuses on generative adversarial network (GAN)-based Denoising and Restoration to remove adversarial noise. In this paper, GAN-based methods are investigated experimentally for assessing their effectiveness. Particularly, three GAN-based approaches, i.e., Blind Face Restoration, Blur and Restore, and Image-to-image Translation, are extensively examined with several representative classification approaches. Our evaluation results show that GAN denoising schemes could improve image visual quality, but are ineffective to remove perturbations for privacy protection attached by Fawkes or Lowkey. We further discuss some future research directions on image transformation-based approaches, which can potentially improve the effectiveness.