{"title":"多阶分数特征语音增强的双路径交互式UNET","authors":"Liyun Xu, Tong Zhang","doi":"10.1016/j.specom.2025.103248","DOIUrl":null,"url":null,"abstract":"<div><div>Preprocessing techniques for denoising and enhancement play a crucial role in significantly improving speech recognition performance. In neural-network-based speech enhancement methods, input features provide the network with essential information to learn from the data. In this study, we introduced multi-order fractional features into a speech enhancement network. These features can represent fine details and offer the advantages of multidomain joint analysis, thereby expanding the input information available to the network. Subsequently, a new dual-path UNET network was designed, in which pure speech and noise are estimated separately. By leveraging the complementarity of the two-branch target estimation, we introduced a fractional information interaction module between the two paths for parameter optimization. Finally, the association module combined the two output information streams to enhance the speech performance. The results from ablation experiments demonstrated the effectiveness of both the multi-order fractional features and the improved dual-path network. Comparison experiments revealed that the proposed algorithm significantly improved speech quality and intelligibility.</div></div>","PeriodicalId":49485,"journal":{"name":"Speech Communication","volume":"172 ","pages":"Article 103248"},"PeriodicalIF":3.0000,"publicationDate":"2025-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dual-path and interactive UNET for speech enhancement with multi-order fractional features\",\"authors\":\"Liyun Xu, Tong Zhang\",\"doi\":\"10.1016/j.specom.2025.103248\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Preprocessing techniques for denoising and enhancement play a crucial role in significantly improving speech recognition performance. In neural-network-based speech enhancement methods, input features provide the network with essential information to learn from the data. In this study, we introduced multi-order fractional features into a speech enhancement network. These features can represent fine details and offer the advantages of multidomain joint analysis, thereby expanding the input information available to the network. Subsequently, a new dual-path UNET network was designed, in which pure speech and noise are estimated separately. By leveraging the complementarity of the two-branch target estimation, we introduced a fractional information interaction module between the two paths for parameter optimization. Finally, the association module combined the two output information streams to enhance the speech performance. The results from ablation experiments demonstrated the effectiveness of both the multi-order fractional features and the improved dual-path network. Comparison experiments revealed that the proposed algorithm significantly improved speech quality and intelligibility.</div></div>\",\"PeriodicalId\":49485,\"journal\":{\"name\":\"Speech Communication\",\"volume\":\"172 \",\"pages\":\"Article 103248\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2025-05-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Speech Communication\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0167639325000639\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ACOUSTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Speech Communication","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167639325000639","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ACOUSTICS","Score":null,"Total":0}
Dual-path and interactive UNET for speech enhancement with multi-order fractional features
Preprocessing techniques for denoising and enhancement play a crucial role in significantly improving speech recognition performance. In neural-network-based speech enhancement methods, input features provide the network with essential information to learn from the data. In this study, we introduced multi-order fractional features into a speech enhancement network. These features can represent fine details and offer the advantages of multidomain joint analysis, thereby expanding the input information available to the network. Subsequently, a new dual-path UNET network was designed, in which pure speech and noise are estimated separately. By leveraging the complementarity of the two-branch target estimation, we introduced a fractional information interaction module between the two paths for parameter optimization. Finally, the association module combined the two output information streams to enhance the speech performance. The results from ablation experiments demonstrated the effectiveness of both the multi-order fractional features and the improved dual-path network. Comparison experiments revealed that the proposed algorithm significantly improved speech quality and intelligibility.
期刊介绍:
Speech Communication is an interdisciplinary journal whose primary objective is to fulfil the need for the rapid dissemination and thorough discussion of basic and applied research results.
The journal''s primary objectives are:
• to present a forum for the advancement of human and human-machine speech communication science;
• to stimulate cross-fertilization between different fields of this domain;
• to contribute towards the rapid and wide diffusion of scientifically sound contributions in this domain.