Developing in-vehicular noise robust children ASR system using Tandem-NN-based acoustic modelling

Q4 Engineering
Virender Kadyan, Shashi Bala, Puneet Bawa, Mohit Mittal
{"title":"Developing in-vehicular noise robust children ASR system using Tandem-NN-based acoustic modelling","authors":"Virender Kadyan, Shashi Bala, Puneet Bawa, Mohit Mittal","doi":"10.1504/ijvas.2020.10039663","DOIUrl":null,"url":null,"abstract":"Processing of children's speech is always challenging due to data scarcity and inefficient modelling input feature vectors. Accuracy of the modelling phase is always dependent upon extracted input features. In this paper, posterior probabilities are estimated over a phone set using first discriminatively trained model through neural-net pre-processor. This Neural Network (NN) classifier is first trained on original speech and then context-independent phone posterior probabilities are estimated on Tandem-NN system. The output vectors are employed as default features which are processed on Deep Neural Network-Hidden Markov Model (DNN-HMM) models. The original data-based system performance is improved by extending it using data augmentation. To see the robustness of the augmented speech various in-vehicle data are investigated and found that it is superior to that of other systems. Finally, we combine all augmented data to overcome data scarcity challenges to enhance system performance. It gives a relative improvement of 23.77% over the baseline system.","PeriodicalId":39322,"journal":{"name":"International Journal of Vehicle Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2020-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Vehicle Autonomous Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1504/ijvas.2020.10039663","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Engineering","Score":null,"Total":0}
引用次数: 1

Abstract

Processing of children's speech is always challenging due to data scarcity and inefficient modelling input feature vectors. Accuracy of the modelling phase is always dependent upon extracted input features. In this paper, posterior probabilities are estimated over a phone set using first discriminatively trained model through neural-net pre-processor. This Neural Network (NN) classifier is first trained on original speech and then context-independent phone posterior probabilities are estimated on Tandem-NN system. The output vectors are employed as default features which are processed on Deep Neural Network-Hidden Markov Model (DNN-HMM) models. The original data-based system performance is improved by extending it using data augmentation. To see the robustness of the augmented speech various in-vehicle data are investigated and found that it is superior to that of other systems. Finally, we combine all augmented data to overcome data scarcity challenges to enhance system performance. It gives a relative improvement of 23.77% over the baseline system.
基于串联神经网络声学建模的车载噪声鲁棒儿童ASR系统
由于数据稀缺和输入特征向量建模效率低下,儿童语音的处理一直是一个挑战。建模阶段的准确性总是依赖于提取的输入特征。本文通过神经网络预处理器,利用第一判别训练模型估计了电话机的后验概率。该神经网络分类器首先在原始语音上进行训练,然后在Tandem-NN系统上估计与上下文无关的电话后验概率。输出向量作为默认特征,在深度神经网络-隐马尔可夫模型(DNN-HMM)模型上进行处理。利用数据增强技术对原有的基于数据的系统进行了扩展,提高了系统性能。为了验证增强语音的鲁棒性,对各种车载数据进行了研究,发现它优于其他系统。最后,我们结合所有增强数据来克服数据稀缺性挑战,以提高系统性能。与基准系统相比,该系统的相对性能提高了23.77%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
International Journal of Vehicle Autonomous Systems
International Journal of Vehicle Autonomous Systems Engineering-Automotive Engineering
CiteScore
1.30
自引率
0.00%
发文量
0
期刊介绍: The IJVAS provides an international forum and refereed reference in the field of vehicle autonomous systems research and development.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信