数据驱动的人脸幻觉的逆退化神经网络

Ruobo Xu, Jiaming Wang, T. Lu
{"title":"数据驱动的人脸幻觉的逆退化神经网络","authors":"Ruobo Xu, Jiaming Wang, T. Lu","doi":"10.1145/3366715.3366744","DOIUrl":null,"url":null,"abstract":"Face hallucination refers to the technology that inferring its potential corresponding high-resolution (HR) image from the input low-resolution (LR) facial image. At present, most face hallucination algorithms improve reconstruction performance by optimizing models. However, the common approach will out of operation when meeting more complex problem, etc, the input image contains degraded pixels (noise), their reconstruction performance will drop sharply. In order to solve the problem, we propose an inverse degradation neural network (IDNN), which can mine the essential features of the images under data-driven. In this network, we design different network structures in different task stages. Firstly, the more accurated face structure is generated by the denoising network in the LR space. But the details from the face image is lacked in this stage. In order to further enhance the face image details, we utilize the reconstruction network to restore the missing details. The experimental results on FEI face database show that IDNN outperforms some state-of-the-art approaches in subjective and objective measures.","PeriodicalId":425980,"journal":{"name":"Proceedings of the 2019 International Conference on Robotics Systems and Vehicle Technology - RSVT '19","volume":"18 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Data-driven Face Hallucination by Inverse Degradation Neural Network\",\"authors\":\"Ruobo Xu, Jiaming Wang, T. Lu\",\"doi\":\"10.1145/3366715.3366744\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Face hallucination refers to the technology that inferring its potential corresponding high-resolution (HR) image from the input low-resolution (LR) facial image. At present, most face hallucination algorithms improve reconstruction performance by optimizing models. However, the common approach will out of operation when meeting more complex problem, etc, the input image contains degraded pixels (noise), their reconstruction performance will drop sharply. In order to solve the problem, we propose an inverse degradation neural network (IDNN), which can mine the essential features of the images under data-driven. In this network, we design different network structures in different task stages. Firstly, the more accurated face structure is generated by the denoising network in the LR space. But the details from the face image is lacked in this stage. In order to further enhance the face image details, we utilize the reconstruction network to restore the missing details. The experimental results on FEI face database show that IDNN outperforms some state-of-the-art approaches in subjective and objective measures.\",\"PeriodicalId\":425980,\"journal\":{\"name\":\"Proceedings of the 2019 International Conference on Robotics Systems and Vehicle Technology - RSVT '19\",\"volume\":\"18 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-10-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2019 International Conference on Robotics Systems and Vehicle Technology - RSVT '19\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3366715.3366744\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2019 International Conference on Robotics Systems and Vehicle Technology - RSVT '19","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3366715.3366744","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

人脸幻觉是指从输入的低分辨率(LR)面部图像中推断出其潜在对应的高分辨率(HR)图像的技术。目前,大多数人脸幻觉算法通过优化模型来提高重建性能。然而,当遇到更复杂的问题时,常见的方法将失效,如输入图像中含有退化的像素(噪声),其重建性能将急剧下降。为了解决这个问题,我们提出了一种逆退化神经网络(IDNN),它可以在数据驱动下挖掘图像的本质特征。在该网络中,我们针对不同的任务阶段设计了不同的网络结构。首先,利用LR空间的去噪网络生成更精确的人脸结构;但是这一阶段缺少人脸图像的细节信息。为了进一步增强人脸图像的细节,我们利用重建网络来恢复缺失的细节。在FEI人脸数据库上的实验结果表明,IDNN在主观和客观度量上都优于一些最先进的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Data-driven Face Hallucination by Inverse Degradation Neural Network
Face hallucination refers to the technology that inferring its potential corresponding high-resolution (HR) image from the input low-resolution (LR) facial image. At present, most face hallucination algorithms improve reconstruction performance by optimizing models. However, the common approach will out of operation when meeting more complex problem, etc, the input image contains degraded pixels (noise), their reconstruction performance will drop sharply. In order to solve the problem, we propose an inverse degradation neural network (IDNN), which can mine the essential features of the images under data-driven. In this network, we design different network structures in different task stages. Firstly, the more accurated face structure is generated by the denoising network in the LR space. But the details from the face image is lacked in this stage. In order to further enhance the face image details, we utilize the reconstruction network to restore the missing details. The experimental results on FEI face database show that IDNN outperforms some state-of-the-art approaches in subjective and objective measures.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信