基于u - net的保留网络,用于单通道语音增强

IF 3.1 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Yuxuan Zhang , Zipeng Zhang , Weiwei Guo , Wei Chen , Zhaohai Liu , Houguang Liu
{"title":"基于u - net的保留网络,用于单通道语音增强","authors":"Yuxuan Zhang ,&nbsp;Zipeng Zhang ,&nbsp;Weiwei Guo ,&nbsp;Wei Chen ,&nbsp;Zhaohai Liu ,&nbsp;Houguang Liu","doi":"10.1016/j.csl.2025.101798","DOIUrl":null,"url":null,"abstract":"<div><div>Speech enhancement is an essential component of many user-oriented audio applications, serving as a fundamental task for achieving robust speech processing. Although numerous methods for speech enhancement have been proposed and have shown strong performance, a notable gap persists in the development of lightweight solutions that effectively balance performance with computational efficiency. This paper addresses a significant gap in the field by introducing a novel approach to speech enhancement that integrates a retentive mechanism within a U-Net architecture. The primary innovation of the proposed method is the design and implementation of a high-frequency future filter module, which utilizes the Fast Fourier Transform (FFT) to improve the model’s capacity to preserve and process high-frequency information that is essential for speech clarity. This module, in conjunction with the retentive mechanism, enables the network to preserve essential features across layers, resulting in enhanced speech enhancement performance. The proposed method was assessed utilizing the DNS (Deep Noise Suppression) and VoiceBank+DEMAND dataset, which are widely recognized benchmarks in the field of speech enhancement. The experimental results demonstrate that the proposed method achieves competitive performance while maintaining relatively low computational complexity. This characteristic renders our method particularly suitable for real-time applications, where both performance and efficiency are critical.</div></div>","PeriodicalId":50638,"journal":{"name":"Computer Speech and Language","volume":"93 ","pages":"Article 101798"},"PeriodicalIF":3.1000,"publicationDate":"2025-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"LRetUNet: A U-Net-based retentive network for single-channel speech enhancement\",\"authors\":\"Yuxuan Zhang ,&nbsp;Zipeng Zhang ,&nbsp;Weiwei Guo ,&nbsp;Wei Chen ,&nbsp;Zhaohai Liu ,&nbsp;Houguang Liu\",\"doi\":\"10.1016/j.csl.2025.101798\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Speech enhancement is an essential component of many user-oriented audio applications, serving as a fundamental task for achieving robust speech processing. Although numerous methods for speech enhancement have been proposed and have shown strong performance, a notable gap persists in the development of lightweight solutions that effectively balance performance with computational efficiency. This paper addresses a significant gap in the field by introducing a novel approach to speech enhancement that integrates a retentive mechanism within a U-Net architecture. The primary innovation of the proposed method is the design and implementation of a high-frequency future filter module, which utilizes the Fast Fourier Transform (FFT) to improve the model’s capacity to preserve and process high-frequency information that is essential for speech clarity. This module, in conjunction with the retentive mechanism, enables the network to preserve essential features across layers, resulting in enhanced speech enhancement performance. The proposed method was assessed utilizing the DNS (Deep Noise Suppression) and VoiceBank+DEMAND dataset, which are widely recognized benchmarks in the field of speech enhancement. The experimental results demonstrate that the proposed method achieves competitive performance while maintaining relatively low computational complexity. This characteristic renders our method particularly suitable for real-time applications, where both performance and efficiency are critical.</div></div>\",\"PeriodicalId\":50638,\"journal\":{\"name\":\"Computer Speech and Language\",\"volume\":\"93 \",\"pages\":\"Article 101798\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2025-03-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Speech and Language\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0885230825000233\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Speech and Language","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0885230825000233","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

语音增强是许多面向用户的音频应用程序的重要组成部分,是实现鲁棒语音处理的基本任务。尽管已经提出了许多语音增强方法并显示出强大的性能,但在开发有效平衡性能与计算效率的轻量级解决方案方面仍然存在明显的差距。本文通过引入一种新的语音增强方法,在U-Net体系结构中集成了一种保留机制,解决了该领域的一个重大空白。该方法的主要创新是设计和实现高频未来滤波器模块,该模块利用快速傅里叶变换(FFT)来提高模型保存和处理高频信息的能力,这些信息对语音清晰度至关重要。该模块与保留机制相结合,使网络能够跨层保留基本特征,从而增强语音增强性能。利用深度噪声抑制(Deep Noise Suppression)和VoiceBank+DEMAND数据集对该方法进行了评估,这两个数据集是语音增强领域公认的基准。实验结果表明,该方法在保持较低的计算复杂度的同时取得了较好的性能。这种特性使得我们的方法特别适合于性能和效率都至关重要的实时应用程序。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
LRetUNet: A U-Net-based retentive network for single-channel speech enhancement
Speech enhancement is an essential component of many user-oriented audio applications, serving as a fundamental task for achieving robust speech processing. Although numerous methods for speech enhancement have been proposed and have shown strong performance, a notable gap persists in the development of lightweight solutions that effectively balance performance with computational efficiency. This paper addresses a significant gap in the field by introducing a novel approach to speech enhancement that integrates a retentive mechanism within a U-Net architecture. The primary innovation of the proposed method is the design and implementation of a high-frequency future filter module, which utilizes the Fast Fourier Transform (FFT) to improve the model’s capacity to preserve and process high-frequency information that is essential for speech clarity. This module, in conjunction with the retentive mechanism, enables the network to preserve essential features across layers, resulting in enhanced speech enhancement performance. The proposed method was assessed utilizing the DNS (Deep Noise Suppression) and VoiceBank+DEMAND dataset, which are widely recognized benchmarks in the field of speech enhancement. The experimental results demonstrate that the proposed method achieves competitive performance while maintaining relatively low computational complexity. This characteristic renders our method particularly suitable for real-time applications, where both performance and efficiency are critical.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computer Speech and Language
Computer Speech and Language 工程技术-计算机:人工智能
CiteScore
11.30
自引率
4.70%
发文量
80
审稿时长
22.9 weeks
期刊介绍: Computer Speech & Language publishes reports of original research related to the recognition, understanding, production, coding and mining of speech and language. The speech and language sciences have a long history, but it is only relatively recently that large-scale implementation of and experimentation with complex models of speech and language processing has become feasible. Such research is often carried out somewhat separately by practitioners of artificial intelligence, computer science, electronic engineering, information retrieval, linguistics, phonetics, or psychology.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信