Convolutional Neural Network for ASR

Abstract

In Automatic speech recognition paradigm has been shifted from statistical model (GMM-HMM) to deep neural network. Among various types of Deep neural networks architecture, CNNs have been most broadly used and considered. There are many advanced features in CNNs like weight sharing, local filters and pooling etc. An ideal pooling method is to be expected to extract only useful information and discards irrelevant details. Pooling is an important component of CNN to be highlighted. Hence, to understand and select the best pooling technique, this paper aims to provide a broad survey on different types of pooling techniques applied in CNNs architecture. This paper will also summarize the improvements of CNNs, including key properties of CNNs, architecture of CNNs.