{"title":"基于爱因斯坦矩阵优化的语音去噪多尺度频带融合框架","authors":"Sinan Peng, Junfeng Shen","doi":"10.1016/j.dsp.2025.105442","DOIUrl":null,"url":null,"abstract":"<div><div>Frequency-domain speech enhancement plays a critical role in improving speech quality under complex noise conditions. However, current methods often suffer from limited feature granularity and constrained model complexity. To overcome these limitations, we propose a novel architecture, Einstein matrix-based Fast Fourier Transform with Multi-Band Frequency Feature fusion (EinFFT-MBFF). The model includes two key modules: a quadratic Fast Fourier Transform (FFT) module that projects signals into a high-dimensional “hyper-frequency” domain, where trainable matrix transformations extract fine-grained spectral features; and a multi-scale fusion mechanism that captures both global and local frequency characteristics via parallel sub-networks. To further improve robustness, a dynamic mixed data augmentation strategy is employed by diversifying noise-speech combinations during training. Experiments on DR-VCTK, FSD50K, and REVERB datasets show that under reverberant conditions, the model achieves relative improvements of 1.058% in Wideband Perceptual Evaluation of Speech Quality (WB-PESQ), 1.076% in Narrowband PESQ (NB-PESQ), and 8.15% in Short-Time Objective Intelligibility (STOI). In non-reverberant settings, improvements reach 0.96%, 0.989%, and 5.61%, respectively. Compared with state-of-the-art methods, EinFFT-MBFF achieves better noise suppression and more stable convergence, while preserving computational efficiency through the inherent cross-channel interaction capabilities of the Einstein matrix.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"167 ","pages":"Article 105442"},"PeriodicalIF":2.9000,"publicationDate":"2025-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Einstein matrix-optimized multiscale frequency band fusion framework for speech denoising\",\"authors\":\"Sinan Peng, Junfeng Shen\",\"doi\":\"10.1016/j.dsp.2025.105442\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Frequency-domain speech enhancement plays a critical role in improving speech quality under complex noise conditions. However, current methods often suffer from limited feature granularity and constrained model complexity. To overcome these limitations, we propose a novel architecture, Einstein matrix-based Fast Fourier Transform with Multi-Band Frequency Feature fusion (EinFFT-MBFF). The model includes two key modules: a quadratic Fast Fourier Transform (FFT) module that projects signals into a high-dimensional “hyper-frequency” domain, where trainable matrix transformations extract fine-grained spectral features; and a multi-scale fusion mechanism that captures both global and local frequency characteristics via parallel sub-networks. To further improve robustness, a dynamic mixed data augmentation strategy is employed by diversifying noise-speech combinations during training. Experiments on DR-VCTK, FSD50K, and REVERB datasets show that under reverberant conditions, the model achieves relative improvements of 1.058% in Wideband Perceptual Evaluation of Speech Quality (WB-PESQ), 1.076% in Narrowband PESQ (NB-PESQ), and 8.15% in Short-Time Objective Intelligibility (STOI). In non-reverberant settings, improvements reach 0.96%, 0.989%, and 5.61%, respectively. Compared with state-of-the-art methods, EinFFT-MBFF achieves better noise suppression and more stable convergence, while preserving computational efficiency through the inherent cross-channel interaction capabilities of the Einstein matrix.</div></div>\",\"PeriodicalId\":51011,\"journal\":{\"name\":\"Digital Signal Processing\",\"volume\":\"167 \",\"pages\":\"Article 105442\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2025-07-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1051200425004646\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200425004646","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Einstein matrix-optimized multiscale frequency band fusion framework for speech denoising
Frequency-domain speech enhancement plays a critical role in improving speech quality under complex noise conditions. However, current methods often suffer from limited feature granularity and constrained model complexity. To overcome these limitations, we propose a novel architecture, Einstein matrix-based Fast Fourier Transform with Multi-Band Frequency Feature fusion (EinFFT-MBFF). The model includes two key modules: a quadratic Fast Fourier Transform (FFT) module that projects signals into a high-dimensional “hyper-frequency” domain, where trainable matrix transformations extract fine-grained spectral features; and a multi-scale fusion mechanism that captures both global and local frequency characteristics via parallel sub-networks. To further improve robustness, a dynamic mixed data augmentation strategy is employed by diversifying noise-speech combinations during training. Experiments on DR-VCTK, FSD50K, and REVERB datasets show that under reverberant conditions, the model achieves relative improvements of 1.058% in Wideband Perceptual Evaluation of Speech Quality (WB-PESQ), 1.076% in Narrowband PESQ (NB-PESQ), and 8.15% in Short-Time Objective Intelligibility (STOI). In non-reverberant settings, improvements reach 0.96%, 0.989%, and 5.61%, respectively. Compared with state-of-the-art methods, EinFFT-MBFF achieves better noise suppression and more stable convergence, while preserving computational efficiency through the inherent cross-channel interaction capabilities of the Einstein matrix.
期刊介绍:
Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal.
The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as:
• big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,