Voice Activity Detection Through Adversarial Learning

Supritha M. Shetty, Heena M Shirahatti, Ujwala Patil, Deepak K. T.
{"title":"Voice Activity Detection Through Adversarial Learning","authors":"Supritha M. Shetty, Heena M Shirahatti, Ujwala Patil, Deepak K. T.","doi":"10.1109/wispnet54241.2022.9767144","DOIUrl":null,"url":null,"abstract":"Voice activity detection (VAD) plays an important role as a pre-processing block in many speech processing applications like speech coding, speech enhancement, speech recognition systems, etc. The main objective of VAD algorithm is to identify speech and non-speech regions in a given audio signal. However the challenging task for the VAD systems would be classifying speech/non-speech frames in an input audio signal that are corrupted by noise i.e environmental noise. With a view to address such a problem, we propose a new approach to VAD using a deep generative model. These models have the ability to learn the underlying distribution of target data through adversarial learning process. In this work, we explore Speech Enhancement GAN (SEGAN) which is a variant of GAN, to analyze the VAD application. The proposed work is evaluated on a subset of Apollo speech corpus as the dataset contain speech files with multiple challenges such as multiple speakers with different noise types, different Signal-to-Noise Ratio (SNR) levels, channel distortion and non-speech for a long duration. The performance of the system is evaluated using detection cost function(DCF) metric. The proposed work gives a better result when compared to other state-of-the-art methods.","PeriodicalId":432794,"journal":{"name":"2022 International Conference on Wireless Communications Signal Processing and Networking (WiSPNET)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Wireless Communications Signal Processing and Networking (WiSPNET)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/wispnet54241.2022.9767144","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Voice activity detection (VAD) plays an important role as a pre-processing block in many speech processing applications like speech coding, speech enhancement, speech recognition systems, etc. The main objective of VAD algorithm is to identify speech and non-speech regions in a given audio signal. However the challenging task for the VAD systems would be classifying speech/non-speech frames in an input audio signal that are corrupted by noise i.e environmental noise. With a view to address such a problem, we propose a new approach to VAD using a deep generative model. These models have the ability to learn the underlying distribution of target data through adversarial learning process. In this work, we explore Speech Enhancement GAN (SEGAN) which is a variant of GAN, to analyze the VAD application. The proposed work is evaluated on a subset of Apollo speech corpus as the dataset contain speech files with multiple challenges such as multiple speakers with different noise types, different Signal-to-Noise Ratio (SNR) levels, channel distortion and non-speech for a long duration. The performance of the system is evaluated using detection cost function(DCF) metric. The proposed work gives a better result when compared to other state-of-the-art methods.
通过对抗性学习进行语音活动检测
语音活动检测(VAD)作为预处理模块在语音编码、语音增强、语音识别等语音处理应用中起着重要的作用。VAD算法的主要目标是在给定的音频信号中识别语音和非语音区域。然而,对于VAD系统来说,具有挑战性的任务是对被噪声(即环境噪声)破坏的输入音频信号中的语音/非语音帧进行分类。为了解决这一问题,我们提出了一种使用深度生成模型的VAD新方法。这些模型具有通过对抗性学习过程学习目标数据的底层分布的能力。在这项工作中,我们探讨了语音增强GAN (SEGAN),它是GAN的一种变体,以分析VAD的应用。在Apollo语音语料库的一个子集上对所提出的工作进行了评估,因为该数据集包含具有多种挑战的语音文件,例如具有不同噪声类型的多个说话者,不同的信噪比(SNR)水平,通道失真和长时间的非语音。采用检测成本函数(detection cost function, DCF)度量来评估系统的性能。与其他最先进的方法相比,所提出的工作得到了更好的结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信