研究了在深度去噪自编码器中降低声频分辨率对频谱图的影响

Yan-Tong Chen, Shu-Ting Tsai, J. Hung
{"title":"研究了在深度去噪自编码器中降低声频分辨率对频谱图的影响","authors":"Yan-Tong Chen, Shu-Ting Tsai, J. Hung","doi":"10.1109/ICCE-TW52618.2021.9602986","DOIUrl":null,"url":null,"abstract":"In this study, we investigate the effect of varying the acoustic-frequency resolution of the spectrogram for the input signals of the deep denoising auto-encoder (DDAE). DDAE is a well-known deep learning structure that learns the relationship between the noisy signal and the respective clean noise-free one. The most commonly used representative for the input signal used to train the DDAE might be the spectrogram, which is the ordered series of the short-time Fourier transform (STFT) of each frame for the input signal. In this paper, we attempt to reduce the acoustic-frequency resolution of the STFT to see its effect of the learned DDAE in terms of the quality and intelligibility of the output signals. The preliminary experimental results indicate that halving the input frequency points (i.e., reducing the frequency resolution by a factor of 2) provides the learned DDAE with almost the same speech quality and intelligibility, while it helps to down-scale the input feature as well as reduce the computation complexity of the DDAE.","PeriodicalId":141850,"journal":{"name":"2021 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW)","volume":"9 5 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"The effect of reducing the acoustic-frequency resolution for spectrograms used in deep denoising auto-encoder\",\"authors\":\"Yan-Tong Chen, Shu-Ting Tsai, J. Hung\",\"doi\":\"10.1109/ICCE-TW52618.2021.9602986\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this study, we investigate the effect of varying the acoustic-frequency resolution of the spectrogram for the input signals of the deep denoising auto-encoder (DDAE). DDAE is a well-known deep learning structure that learns the relationship between the noisy signal and the respective clean noise-free one. The most commonly used representative for the input signal used to train the DDAE might be the spectrogram, which is the ordered series of the short-time Fourier transform (STFT) of each frame for the input signal. In this paper, we attempt to reduce the acoustic-frequency resolution of the STFT to see its effect of the learned DDAE in terms of the quality and intelligibility of the output signals. The preliminary experimental results indicate that halving the input frequency points (i.e., reducing the frequency resolution by a factor of 2) provides the learned DDAE with almost the same speech quality and intelligibility, while it helps to down-scale the input feature as well as reduce the computation complexity of the DDAE.\",\"PeriodicalId\":141850,\"journal\":{\"name\":\"2021 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW)\",\"volume\":\"9 5 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-09-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCE-TW52618.2021.9602986\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCE-TW52618.2021.9602986","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

在本研究中,我们研究了改变频谱图的声频分辨率对深度去噪自编码器(DDAE)输入信号的影响。DDAE是一种众所周知的深度学习结构,它学习有噪声信号与相应的干净无噪声信号之间的关系。用于训练DDAE的输入信号最常用的代表可能是频谱图,它是输入信号每帧的短时傅里叶变换(STFT)的有序序列。在本文中,我们试图降低STFT的声频分辨率,以观察其对学习后的DDAE在输出信号的质量和可理解性方面的影响。初步实验结果表明,将输入频率点减半(即频率分辨率降低1 / 2)可以使学习后的DDAE具有几乎相同的语音质量和可理解性,同时有助于缩小输入特征的规模,降低DDAE的计算复杂度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
The effect of reducing the acoustic-frequency resolution for spectrograms used in deep denoising auto-encoder
In this study, we investigate the effect of varying the acoustic-frequency resolution of the spectrogram for the input signals of the deep denoising auto-encoder (DDAE). DDAE is a well-known deep learning structure that learns the relationship between the noisy signal and the respective clean noise-free one. The most commonly used representative for the input signal used to train the DDAE might be the spectrogram, which is the ordered series of the short-time Fourier transform (STFT) of each frame for the input signal. In this paper, we attempt to reduce the acoustic-frequency resolution of the STFT to see its effect of the learned DDAE in terms of the quality and intelligibility of the output signals. The preliminary experimental results indicate that halving the input frequency points (i.e., reducing the frequency resolution by a factor of 2) provides the learned DDAE with almost the same speech quality and intelligibility, while it helps to down-scale the input feature as well as reduce the computation complexity of the DDAE.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信