基于爱因斯坦矩阵优化的语音去噪多尺度频带融合框架

IF 2.9 3区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Sinan Peng, Junfeng Shen
{"title":"基于爱因斯坦矩阵优化的语音去噪多尺度频带融合框架","authors":"Sinan Peng,&nbsp;Junfeng Shen","doi":"10.1016/j.dsp.2025.105442","DOIUrl":null,"url":null,"abstract":"<div><div>Frequency-domain speech enhancement plays a critical role in improving speech quality under complex noise conditions. However, current methods often suffer from limited feature granularity and constrained model complexity. To overcome these limitations, we propose a novel architecture, Einstein matrix-based Fast Fourier Transform with Multi-Band Frequency Feature fusion (EinFFT-MBFF). The model includes two key modules: a quadratic Fast Fourier Transform (FFT) module that projects signals into a high-dimensional “hyper-frequency” domain, where trainable matrix transformations extract fine-grained spectral features; and a multi-scale fusion mechanism that captures both global and local frequency characteristics via parallel sub-networks. To further improve robustness, a dynamic mixed data augmentation strategy is employed by diversifying noise-speech combinations during training. Experiments on DR-VCTK, FSD50K, and REVERB datasets show that under reverberant conditions, the model achieves relative improvements of 1.058% in Wideband Perceptual Evaluation of Speech Quality (WB-PESQ), 1.076% in Narrowband PESQ (NB-PESQ), and 8.15% in Short-Time Objective Intelligibility (STOI). In non-reverberant settings, improvements reach 0.96%, 0.989%, and 5.61%, respectively. Compared with state-of-the-art methods, EinFFT-MBFF achieves better noise suppression and more stable convergence, while preserving computational efficiency through the inherent cross-channel interaction capabilities of the Einstein matrix.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"167 ","pages":"Article 105442"},"PeriodicalIF":2.9000,"publicationDate":"2025-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Einstein matrix-optimized multiscale frequency band fusion framework for speech denoising\",\"authors\":\"Sinan Peng,&nbsp;Junfeng Shen\",\"doi\":\"10.1016/j.dsp.2025.105442\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Frequency-domain speech enhancement plays a critical role in improving speech quality under complex noise conditions. However, current methods often suffer from limited feature granularity and constrained model complexity. To overcome these limitations, we propose a novel architecture, Einstein matrix-based Fast Fourier Transform with Multi-Band Frequency Feature fusion (EinFFT-MBFF). The model includes two key modules: a quadratic Fast Fourier Transform (FFT) module that projects signals into a high-dimensional “hyper-frequency” domain, where trainable matrix transformations extract fine-grained spectral features; and a multi-scale fusion mechanism that captures both global and local frequency characteristics via parallel sub-networks. To further improve robustness, a dynamic mixed data augmentation strategy is employed by diversifying noise-speech combinations during training. Experiments on DR-VCTK, FSD50K, and REVERB datasets show that under reverberant conditions, the model achieves relative improvements of 1.058% in Wideband Perceptual Evaluation of Speech Quality (WB-PESQ), 1.076% in Narrowband PESQ (NB-PESQ), and 8.15% in Short-Time Objective Intelligibility (STOI). In non-reverberant settings, improvements reach 0.96%, 0.989%, and 5.61%, respectively. Compared with state-of-the-art methods, EinFFT-MBFF achieves better noise suppression and more stable convergence, while preserving computational efficiency through the inherent cross-channel interaction capabilities of the Einstein matrix.</div></div>\",\"PeriodicalId\":51011,\"journal\":{\"name\":\"Digital Signal Processing\",\"volume\":\"167 \",\"pages\":\"Article 105442\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2025-07-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1051200425004646\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200425004646","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

在复杂噪声条件下,频域语音增强对提高语音质量起着至关重要的作用。然而,现有的方法往往存在特征粒度有限和模型复杂性受限的问题。为了克服这些限制,我们提出了一种新的架构,即基于爱因斯坦矩阵的快速傅立叶变换与多频带频率特征融合(EinFFT-MBFF)。该模型包括两个关键模块:一个二次型快速傅里叶变换(FFT)模块,它将信号投射到高维“高频”域,其中可训练的矩阵变换提取细粒度的频谱特征;以及通过并行子网络捕获全局和局部频率特征的多尺度融合机制。为了进一步提高鲁棒性,在训练过程中采用了一种动态混合数据增强策略,使噪声-语音组合多样化。在DR-VCTK、FSD50K和REVERB数据集上进行的实验表明,在混响条件下,该模型在宽带语音质量感知评价(WB-PESQ)、窄带语音质量感知评价(NB-PESQ)和短时客观可理解度(STOI)方面分别实现了1.058%、1.076%和8.15%的相对改进。在非混响设置中,改进分别达到0.96%,0.989%和5.61%。与现有方法相比,EinFFT-MBFF在保持计算效率的同时,通过爱因斯坦矩阵固有的跨通道交互能力,实现了更好的噪声抑制和更稳定的收敛。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Einstein matrix-optimized multiscale frequency band fusion framework for speech denoising

Einstein matrix-optimized multiscale frequency band fusion framework for speech denoising
Frequency-domain speech enhancement plays a critical role in improving speech quality under complex noise conditions. However, current methods often suffer from limited feature granularity and constrained model complexity. To overcome these limitations, we propose a novel architecture, Einstein matrix-based Fast Fourier Transform with Multi-Band Frequency Feature fusion (EinFFT-MBFF). The model includes two key modules: a quadratic Fast Fourier Transform (FFT) module that projects signals into a high-dimensional “hyper-frequency” domain, where trainable matrix transformations extract fine-grained spectral features; and a multi-scale fusion mechanism that captures both global and local frequency characteristics via parallel sub-networks. To further improve robustness, a dynamic mixed data augmentation strategy is employed by diversifying noise-speech combinations during training. Experiments on DR-VCTK, FSD50K, and REVERB datasets show that under reverberant conditions, the model achieves relative improvements of 1.058% in Wideband Perceptual Evaluation of Speech Quality (WB-PESQ), 1.076% in Narrowband PESQ (NB-PESQ), and 8.15% in Short-Time Objective Intelligibility (STOI). In non-reverberant settings, improvements reach 0.96%, 0.989%, and 5.61%, respectively. Compared with state-of-the-art methods, EinFFT-MBFF achieves better noise suppression and more stable convergence, while preserving computational efficiency through the inherent cross-channel interaction capabilities of the Einstein matrix.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Digital Signal Processing
Digital Signal Processing 工程技术-工程:电子与电气
CiteScore
5.30
自引率
17.20%
发文量
435
审稿时长
66 days
期刊介绍: Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal. The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as: • big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信