Temporal convolutional network for speech bandwidth extension

IF 3.1 3区 计算机科学 Q2 TELECOMMUNICATIONS
Chundong Xu, Cheng Zhu, Xianpeng Ling, Dongwen Ying
{"title":"Temporal convolutional network for speech bandwidth extension","authors":"Chundong Xu, Cheng Zhu, Xianpeng Ling, Dongwen Ying","doi":"10.23919/jcc.fa.2021-0174.202311","DOIUrl":null,"url":null,"abstract":"In the field of speech bandwidth extension, it is difficult to achieve high speech quality based on the shallow statistical model method. Although the application of deep learning has greatly improved the extended speech quality, the high model complexity makes it infeasible to run on the client. In order to tackle these issues, this paper proposes an end-to-end speech bandwidth extension method based on a temporal convolutional neural network, which greatly reduces the complexity of the model. In addition, a new time-frequency loss function is designed to enable narrowband speech to acquire a more accurate wideband mapping in the time domain and the frequency domain. The experimental results show that the reconstructed wideband speech generated by the proposed method is superior to the traditional heuristic rule based approaches and the conventional neural network methods for both subjective and objective evaluation.","PeriodicalId":9814,"journal":{"name":"China Communications","volume":null,"pages":null},"PeriodicalIF":3.1000,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"China Communications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/jcc.fa.2021-0174.202311","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

In the field of speech bandwidth extension, it is difficult to achieve high speech quality based on the shallow statistical model method. Although the application of deep learning has greatly improved the extended speech quality, the high model complexity makes it infeasible to run on the client. In order to tackle these issues, this paper proposes an end-to-end speech bandwidth extension method based on a temporal convolutional neural network, which greatly reduces the complexity of the model. In addition, a new time-frequency loss function is designed to enable narrowband speech to acquire a more accurate wideband mapping in the time domain and the frequency domain. The experimental results show that the reconstructed wideband speech generated by the proposed method is superior to the traditional heuristic rule based approaches and the conventional neural network methods for both subjective and objective evaluation.
语音带宽扩展的时间卷积网络
在语音带宽扩展领域,基于浅层统计模型的方法难以实现高质量的语音。虽然深度学习的应用大大提高了扩展语音的质量,但模型的高复杂性使得它无法在客户端上运行。为了解决这些问题,本文提出了一种基于时间卷积神经网络的端到端语音带宽扩展方法,大大降低了模型的复杂度。此外,设计了一种新的时频损失函数,使窄带语音在时域和频域上获得更精确的宽带映射。实验结果表明,该方法生成的重构宽带语音在主客观评价方面均优于传统的启发式规则方法和传统的神经网络方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
China Communications
China Communications 工程技术-电信学
CiteScore
8.00
自引率
12.20%
发文量
2868
审稿时长
8.6 months
期刊介绍: China Communications (ISSN 1673-5447) is an English-language monthly journal cosponsored by the China Institute of Communications (CIC) and IEEE Communications Society (IEEE ComSoc). It is aimed at readers in industry, universities, research and development organizations, and government agencies in the field of Information and Communications Technologies (ICTs) worldwide. The journal's main objective is to promote academic exchange in the ICTs sector and publish high-quality papers to contribute to the global ICTs industry. It provides instant access to the latest articles and papers, presenting leading-edge research achievements, tutorial overviews, and descriptions of significant practical applications of technology. China Communications has been indexed in SCIE (Science Citation Index-Expanded) since January 2007. Additionally, all articles have been available in the IEEE Xplore digital library since January 2013.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信