{"title":"目标特征的激活和归一化及其对基于深度神经网络的语音去噪系统性能影响的研究","authors":"Bo Wu, Kehuang Li, Minglei Yang, Chin-Hui Lee","doi":"10.1109/APSIPA.2016.7820875","DOIUrl":null,"url":null,"abstract":"We adopt a linear activation function at the output layer and globally normalize the target features into zero mean and unit variance to learn the complicated mapping from reverberant to anechoic speech with a regression model based on deep neural networks (DNNs). The proposed feature activation and normalization framework was found to retain clearly observable harmonics and improve the speech quality better than a recently proposed sigmoid activation and min-max normalization scheme. It also outperforms this state-of-the-art algorithm in all objective performance metrics at all reverberation times tested. With a large training set, the proposed DNN-based dereverberation system can consistently improve the restoration of the low-frequency and intermediate-frequency contents of the estimated anechoic spectrograms, essential for human perception. As for a small training set, the proposed DNN system also exhibits a better robustness than the competing algorithm.","PeriodicalId":409448,"journal":{"name":"2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"15","resultStr":"{\"title\":\"A study on target feature activation and normalization and their impacts on the performance of DNN based speech dereverberation systems\",\"authors\":\"Bo Wu, Kehuang Li, Minglei Yang, Chin-Hui Lee\",\"doi\":\"10.1109/APSIPA.2016.7820875\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We adopt a linear activation function at the output layer and globally normalize the target features into zero mean and unit variance to learn the complicated mapping from reverberant to anechoic speech with a regression model based on deep neural networks (DNNs). The proposed feature activation and normalization framework was found to retain clearly observable harmonics and improve the speech quality better than a recently proposed sigmoid activation and min-max normalization scheme. It also outperforms this state-of-the-art algorithm in all objective performance metrics at all reverberation times tested. With a large training set, the proposed DNN-based dereverberation system can consistently improve the restoration of the low-frequency and intermediate-frequency contents of the estimated anechoic spectrograms, essential for human perception. As for a small training set, the proposed DNN system also exhibits a better robustness than the competing algorithm.\",\"PeriodicalId\":409448,\"journal\":{\"name\":\"2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA)\",\"volume\":\"4 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2016-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"15\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/APSIPA.2016.7820875\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/APSIPA.2016.7820875","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A study on target feature activation and normalization and their impacts on the performance of DNN based speech dereverberation systems
We adopt a linear activation function at the output layer and globally normalize the target features into zero mean and unit variance to learn the complicated mapping from reverberant to anechoic speech with a regression model based on deep neural networks (DNNs). The proposed feature activation and normalization framework was found to retain clearly observable harmonics and improve the speech quality better than a recently proposed sigmoid activation and min-max normalization scheme. It also outperforms this state-of-the-art algorithm in all objective performance metrics at all reverberation times tested. With a large training set, the proposed DNN-based dereverberation system can consistently improve the restoration of the low-frequency and intermediate-frequency contents of the estimated anechoic spectrograms, essential for human perception. As for a small training set, the proposed DNN system also exhibits a better robustness than the competing algorithm.