激励源和序列学习对口语识别任务的重要性

Jagabandhu Mishra, Soma Siddhartha, S. Prasanna
{"title":"激励源和序列学习对口语识别任务的重要性","authors":"Jagabandhu Mishra, Soma Siddhartha, S. Prasanna","doi":"10.1109/NCC55593.2022.9806768","DOIUrl":null,"url":null,"abstract":"Spoken LID systems generally capture the long term temporal dynamic information present in the speech signal. To achieve that, sequence modeling techniques are used after the feature extraction process. But, the performance of the spoken LID system degrades in cross channel and noisy scenarios. From the literature, we can observe the benefit of excitation source information in noisy and cross-channel scenarios. Besides that, excitation features are also used as complementary evidence in spoken LID systems with spectral features. Motivated from this, an excitation based feature called integrated residual linear frequency cepstral coefficient (IRLFCC) has been proposed in this work. This work also provides a comparison between various deep learning based sequence modeling architectures towards capturing spoken language specific information. The experiments are performed using OLR2020 dataset. From the experiments, it can be observed that in the cross channel scenario, the proposed best system provides a relative improvement of 70.5% and 57.2% over the baseline in terms of $EER_{avg}$ and $C_{avg}$ respectively. Similarly, in the noisy scenario, the proposed best system provides a relative improvement of 37.8% and 45 % over the baseline system.","PeriodicalId":403870,"journal":{"name":"2022 National Conference on Communications (NCC)","volume":"46 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Importance of excitation source and sequence learning towards spoken language identification task\",\"authors\":\"Jagabandhu Mishra, Soma Siddhartha, S. Prasanna\",\"doi\":\"10.1109/NCC55593.2022.9806768\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Spoken LID systems generally capture the long term temporal dynamic information present in the speech signal. To achieve that, sequence modeling techniques are used after the feature extraction process. But, the performance of the spoken LID system degrades in cross channel and noisy scenarios. From the literature, we can observe the benefit of excitation source information in noisy and cross-channel scenarios. Besides that, excitation features are also used as complementary evidence in spoken LID systems with spectral features. Motivated from this, an excitation based feature called integrated residual linear frequency cepstral coefficient (IRLFCC) has been proposed in this work. This work also provides a comparison between various deep learning based sequence modeling architectures towards capturing spoken language specific information. The experiments are performed using OLR2020 dataset. From the experiments, it can be observed that in the cross channel scenario, the proposed best system provides a relative improvement of 70.5% and 57.2% over the baseline in terms of $EER_{avg}$ and $C_{avg}$ respectively. Similarly, in the noisy scenario, the proposed best system provides a relative improvement of 37.8% and 45 % over the baseline system.\",\"PeriodicalId\":403870,\"journal\":{\"name\":\"2022 National Conference on Communications (NCC)\",\"volume\":\"46 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-05-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 National Conference on Communications (NCC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/NCC55593.2022.9806768\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 National Conference on Communications (NCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NCC55593.2022.9806768","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

语音LID系统通常捕获存在于语音信号中的长时间动态信息。为了实现这一目标,在特征提取过程之后使用序列建模技术。但是,在交叉信道和噪声情况下,语音LID系统的性能会下降。从文献中,我们可以观察到激发源信息在噪声和跨信道情况下的好处。此外,在具有谱特征的语音LID系统中,激励特征也被用作补充证据。基于此,本文提出了一种基于激励的特征,称为积分残差线性频率倒谱系数(IRLFCC)。这项工作还提供了各种基于深度学习的序列建模架构之间的比较,以捕获口语特定信息。实验采用OLR2020数据集。从实验中可以观察到,在跨通道场景下,所提出的最佳系统在$EER_{avg}$和$C_{avg}$方面分别比基线提高了70.5%和57.2%。同样,在有噪声的情况下,建议的最佳系统比基线系统提供了37.8%和45%的相对改进。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Importance of excitation source and sequence learning towards spoken language identification task
Spoken LID systems generally capture the long term temporal dynamic information present in the speech signal. To achieve that, sequence modeling techniques are used after the feature extraction process. But, the performance of the spoken LID system degrades in cross channel and noisy scenarios. From the literature, we can observe the benefit of excitation source information in noisy and cross-channel scenarios. Besides that, excitation features are also used as complementary evidence in spoken LID systems with spectral features. Motivated from this, an excitation based feature called integrated residual linear frequency cepstral coefficient (IRLFCC) has been proposed in this work. This work also provides a comparison between various deep learning based sequence modeling architectures towards capturing spoken language specific information. The experiments are performed using OLR2020 dataset. From the experiments, it can be observed that in the cross channel scenario, the proposed best system provides a relative improvement of 70.5% and 57.2% over the baseline in terms of $EER_{avg}$ and $C_{avg}$ respectively. Similarly, in the noisy scenario, the proposed best system provides a relative improvement of 37.8% and 45 % over the baseline system.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信