Efficient face image super-resolution with convenient alternating projection network

IF 1.1 4区 工程技术 Q4 ENGINEERING, ELECTRICAL & ELECTRONIC
Xitong Chen, Yuntao Wu, Jiangchuan Chen, Jiaming Wang, Kangli Zeng
{"title":"Efficient face image super-resolution with convenient alternating projection network","authors":"Xitong Chen,&nbsp;Yuntao Wu,&nbsp;Jiangchuan Chen,&nbsp;Jiaming Wang,&nbsp;Kangli Zeng","doi":"10.1049/sil2.12205","DOIUrl":null,"url":null,"abstract":"<p>The existing deep learning-based face super-resolution techniques can achieve satisfactory performance. However, these methods often incur large computational costs, and deeper networks generate redundant features. Some lightweight reconstruction networks also present limited representation ability because they ignore the entire contour and fine texture of the face for the sake of efficiency. Here, the authors propose a convenient alternating projection network (CAPN) for efficient face super-resolution. First, the authors design a novel alternating projection block cascaded convolutional neural network to alternately achieve content consistency and learn detailed facial feature differences between super-resolution and ground-truth face images. Second, the self-correction mechanism enabled the convolutional layer to capture faithful features that facilitate adaptive reconstruction. Moreover, a convenient connection operation can reduce the generation of redundant facial features while maintaining accurate reconstruction information. Extensive experiments demonstrated that the proposed CAPN can effectively reduce the computational cost while achieving competitive qualitative and quantitative results compared to state-of-the-art super-resolution methods.</p>","PeriodicalId":56301,"journal":{"name":"IET Signal Processing","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2023-04-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/sil2.12205","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/sil2.12205","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

The existing deep learning-based face super-resolution techniques can achieve satisfactory performance. However, these methods often incur large computational costs, and deeper networks generate redundant features. Some lightweight reconstruction networks also present limited representation ability because they ignore the entire contour and fine texture of the face for the sake of efficiency. Here, the authors propose a convenient alternating projection network (CAPN) for efficient face super-resolution. First, the authors design a novel alternating projection block cascaded convolutional neural network to alternately achieve content consistency and learn detailed facial feature differences between super-resolution and ground-truth face images. Second, the self-correction mechanism enabled the convolutional layer to capture faithful features that facilitate adaptive reconstruction. Moreover, a convenient connection operation can reduce the generation of redundant facial features while maintaining accurate reconstruction information. Extensive experiments demonstrated that the proposed CAPN can effectively reduce the computational cost while achieving competitive qualitative and quantitative results compared to state-of-the-art super-resolution methods.

Abstract Image

利用方便的交替投影网络实现高效的人脸图像超分辨率
现有的基于深度学习的人脸超分辨率技术可以获得令人满意的性能。然而,这些方法通常会产生巨大的计算成本,并且更深的网络会产生冗余特征。一些轻量级重建网络也表现出有限的表示能力,因为它们为了效率而忽略了面部的整个轮廓和精细纹理。在此,作者提出了一种方便的交替投影网络(CAPN),用于高效的人脸超分辨率。首先,作者设计了一种新的交替投影块级联卷积神经网络,以交替实现内容一致性,并学习超分辨率和真实人脸图像之间的详细人脸特征差异。其次,自校正机制使卷积层能够捕获有助于自适应重建的忠实特征。此外,方便的连接操作可以减少冗余面部特征的产生,同时保持准确的重建信息。大量实验表明,与最先进的超分辨率方法相比,所提出的CAPN可以有效地降低计算成本,同时获得有竞争力的定性和定量结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IET Signal Processing
IET Signal Processing 工程技术-工程:电子与电气
CiteScore
3.80
自引率
5.90%
发文量
83
审稿时长
9.5 months
期刊介绍: IET Signal Processing publishes research on a diverse range of signal processing and machine learning topics, covering a variety of applications, disciplines, modalities, and techniques in detection, estimation, inference, and classification problems. The research published includes advances in algorithm design for the analysis of single and high-multi-dimensional data, sparsity, linear and non-linear systems, recursive and non-recursive digital filters and multi-rate filter banks, as well a range of topics that span from sensor array processing, deep convolutional neural network based approaches to the application of chaos theory, and far more. Topics covered by scope include, but are not limited to: advances in single and multi-dimensional filter design and implementation linear and nonlinear, fixed and adaptive digital filters and multirate filter banks statistical signal processing techniques and analysis classical, parametric and higher order spectral analysis signal transformation and compression techniques, including time-frequency analysis system modelling and adaptive identification techniques machine learning based approaches to signal processing Bayesian methods for signal processing, including Monte-Carlo Markov-chain and particle filtering techniques theory and application of blind and semi-blind signal separation techniques signal processing techniques for analysis, enhancement, coding, synthesis and recognition of speech signals direction-finding and beamforming techniques for audio and electromagnetic signals analysis techniques for biomedical signals baseband signal processing techniques for transmission and reception of communication signals signal processing techniques for data hiding and audio watermarking sparse signal processing and compressive sensing Special Issue Call for Papers: Intelligent Deep Fuzzy Model for Signal Processing - https://digital-library.theiet.org/files/IET_SPR_CFP_IDFMSP.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信