通过改进边缘和身份保持网络增强人脸超分辨率

Mostafa Balouchzehi Shahbakhsh, H. Hassanpour
{"title":"通过改进边缘和身份保持网络增强人脸超分辨率","authors":"Mostafa Balouchzehi Shahbakhsh, H. Hassanpour","doi":"10.1109/ICSPIS54653.2021.9729372","DOIUrl":null,"url":null,"abstract":"Face super-resolution, known as face hallucination, is a domain-specific image super-resolution problem, which refers to generating high resolution face images from their low resolution. State-of-the-art face super-resolution methods used deep convolutional neural networks. However, due to significant pose changes and difficulty in recovering high-frequency details in facial areas, most of these methods do not deploy facial structures and identity information well, and it is tough for them to reconstruct super-resolved face images. According to previous researches, proper use of low-resolution image edges can be a solution for these problems. EIPNet (Edge and Identity Preserving Network) is one of the newest methods to achieve outstanding results in this area. In the EIPNet method, the authors used a lightweight edge extraction block in the proposed GAN structure. In this research, we intend to improve the performance of the EIPNet method by presenting a simple but efficient technique. Our proposed technique divides the face images into upper and lower parts. We train a separate network for each area. This technique reduces the number of face components to train from each area, and the networks can better be trained from their components. The results show that this technique can have an excellent effect on visual quality and quantitative measurements in face super-resolution.","PeriodicalId":286966,"journal":{"name":"2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Enhancing Face Super-Resolution via Improving the Edge and Identity Preserving Network\",\"authors\":\"Mostafa Balouchzehi Shahbakhsh, H. Hassanpour\",\"doi\":\"10.1109/ICSPIS54653.2021.9729372\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Face super-resolution, known as face hallucination, is a domain-specific image super-resolution problem, which refers to generating high resolution face images from their low resolution. State-of-the-art face super-resolution methods used deep convolutional neural networks. However, due to significant pose changes and difficulty in recovering high-frequency details in facial areas, most of these methods do not deploy facial structures and identity information well, and it is tough for them to reconstruct super-resolved face images. According to previous researches, proper use of low-resolution image edges can be a solution for these problems. EIPNet (Edge and Identity Preserving Network) is one of the newest methods to achieve outstanding results in this area. In the EIPNet method, the authors used a lightweight edge extraction block in the proposed GAN structure. In this research, we intend to improve the performance of the EIPNet method by presenting a simple but efficient technique. Our proposed technique divides the face images into upper and lower parts. We train a separate network for each area. This technique reduces the number of face components to train from each area, and the networks can better be trained from their components. The results show that this technique can have an excellent effect on visual quality and quantitative measurements in face super-resolution.\",\"PeriodicalId\":286966,\"journal\":{\"name\":\"2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-12-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSPIS54653.2021.9729372\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSPIS54653.2021.9729372","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

人脸超分辨率,又称人脸幻觉,是一种特定领域的图像超分辨率问题,指的是将低分辨率的人脸图像生成高分辨率的人脸图像。最先进的面部超分辨率方法使用了深度卷积神经网络。然而,由于姿态变化较大,难以恢复面部区域的高频细节,这些方法大多不能很好地部署面部结构和身份信息,难以重建超分辨人脸图像。根据以往的研究,适当使用低分辨率的图像边缘可以解决这些问题。边缘和身份保持网络(EIPNet)是在该领域取得突出成果的最新方法之一。在EIPNet方法中,作者在提出的GAN结构中使用了轻量级的边缘提取块。在这项研究中,我们打算通过提出一种简单而有效的技术来提高EIPNet方法的性能。我们提出的技术将人脸图像分为上下两个部分。我们为每个区域训练一个单独的网络。这种技术减少了从每个区域训练的人脸成分的数量,并且可以更好地从它们的成分中训练网络。结果表明,该技术在人脸超分辨率的视觉质量和定量测量方面都有很好的效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Enhancing Face Super-Resolution via Improving the Edge and Identity Preserving Network
Face super-resolution, known as face hallucination, is a domain-specific image super-resolution problem, which refers to generating high resolution face images from their low resolution. State-of-the-art face super-resolution methods used deep convolutional neural networks. However, due to significant pose changes and difficulty in recovering high-frequency details in facial areas, most of these methods do not deploy facial structures and identity information well, and it is tough for them to reconstruct super-resolved face images. According to previous researches, proper use of low-resolution image edges can be a solution for these problems. EIPNet (Edge and Identity Preserving Network) is one of the newest methods to achieve outstanding results in this area. In the EIPNet method, the authors used a lightweight edge extraction block in the proposed GAN structure. In this research, we intend to improve the performance of the EIPNet method by presenting a simple but efficient technique. Our proposed technique divides the face images into upper and lower parts. We train a separate network for each area. This technique reduces the number of face components to train from each area, and the networks can better be trained from their components. The results show that this technique can have an excellent effect on visual quality and quantitative measurements in face super-resolution.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信