{"title":"Low-complexity bone conduction-aided speech enhancement leveraging sub-band and full-band architecture","authors":"Kelan Kuang , Feiran Yang , Mou Wang , Jun Yang","doi":"10.1016/j.apacoust.2025.110924","DOIUrl":null,"url":null,"abstract":"<div><div>This paper presents a low-complexity speech enhancement model that jointly utilizes sub-band and full-band features of bone-conducted (BC) and air-conducted (AC) speech. A two-step speech enhancement procedure is considered. In the first step, the proposed model estimates a set of gains of pre-defined sub-bands to enhance the spectral envelope of noisy AC speech, whereas in the second step, the proposed model estimates a set of coefficients to apply deep filtering to the output of the previous step. Specifically, sub-band gains and deep filtering coefficients are estimated from sub-band and full-band features of both AC and BC speech by two sets of encoder-decoder. Additionally, attention-based feature fusion modules are employed to fuse features of AC and BC at an early and intermediate stage. The multiply-accumulate operations per second of the proposed model are 40.3 M, which is lower than that of most existing BC-aided speech enhancement methods. Experimental results on AC and BC speech recorded from 109 individuals demonstrate that the proposed model effectively balances the noise reduction performance and the computational complexity.</div></div>","PeriodicalId":55506,"journal":{"name":"Applied Acoustics","volume":"240 ","pages":"Article 110924"},"PeriodicalIF":3.4000,"publicationDate":"2025-07-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Acoustics","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0003682X25003962","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ACOUSTICS","Score":null,"Total":0}
引用次数: 0
Abstract
This paper presents a low-complexity speech enhancement model that jointly utilizes sub-band and full-band features of bone-conducted (BC) and air-conducted (AC) speech. A two-step speech enhancement procedure is considered. In the first step, the proposed model estimates a set of gains of pre-defined sub-bands to enhance the spectral envelope of noisy AC speech, whereas in the second step, the proposed model estimates a set of coefficients to apply deep filtering to the output of the previous step. Specifically, sub-band gains and deep filtering coefficients are estimated from sub-band and full-band features of both AC and BC speech by two sets of encoder-decoder. Additionally, attention-based feature fusion modules are employed to fuse features of AC and BC at an early and intermediate stage. The multiply-accumulate operations per second of the proposed model are 40.3 M, which is lower than that of most existing BC-aided speech enhancement methods. Experimental results on AC and BC speech recorded from 109 individuals demonstrate that the proposed model effectively balances the noise reduction performance and the computational complexity.
期刊介绍:
Since its launch in 1968, Applied Acoustics has been publishing high quality research papers providing state-of-the-art coverage of research findings for engineers and scientists involved in applications of acoustics in the widest sense.
Applied Acoustics looks not only at recent developments in the understanding of acoustics but also at ways of exploiting that understanding. The Journal aims to encourage the exchange of practical experience through publication and in so doing creates a fund of technological information that can be used for solving related problems. The presentation of information in graphical or tabular form is especially encouraged. If a report of a mathematical development is a necessary part of a paper it is important to ensure that it is there only as an integral part of a practical solution to a problem and is supported by data. Applied Acoustics encourages the exchange of practical experience in the following ways: • Complete Papers • Short Technical Notes • Review Articles; and thereby provides a wealth of technological information that can be used to solve related problems.
Manuscripts that address all fields of applications of acoustics ranging from medicine and NDT to the environment and buildings are welcome.