{"title":"基于MFCC和cnn的泰语句子语音自动识别","authors":"K. Sukvichai, Chaitat Utintu, Warayut Muknumporn","doi":"10.1109/ICA-SYMP50206.2021.9358451","DOIUrl":null,"url":null,"abstract":"An automatic speech recognition (ASR) is more important, especially in the Coronavirus outbreak. ASR for Thai sentence was proposed based on MFCC and CNNs in this research. The MFCC features image created from the Thai speech procedure is explained. The MFCC image is treated as a normal image. Object detection techniques based on CNNs can be used to detect Thai words in the frequency image. You Only Look Once (YOLO) is selected as the word localizer and classifier due to its performance and accuracy. The airport service scenario is explored in this research in order to obtain the performance of the proposed system. The airport information system is selected for the experiments. Speeches were collected from 60 participants with 50% males and 50% females. Speech images are constructed based on MFCC and labeled for specific Thai keywords. The YOLOv3 and Tiny YOLOv3 were trained and the performance was evaluated. Clearly, Tiny YOLOv3 network is good enough for this experiment. New speech data provided from new 20 participants were used to test the proposed system. Resulting in the proposed ASR system based on MFCC and CNNs has a good performance in both speed and accuracy.","PeriodicalId":147047,"journal":{"name":"2021 Second International Symposium on Instrumentation, Control, Artificial Intelligence, and Robotics (ICA-SYMP)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-01-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Automatic Speech Recognition for Thai Sentence based on MFCC and CNNs\",\"authors\":\"K. Sukvichai, Chaitat Utintu, Warayut Muknumporn\",\"doi\":\"10.1109/ICA-SYMP50206.2021.9358451\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"An automatic speech recognition (ASR) is more important, especially in the Coronavirus outbreak. ASR for Thai sentence was proposed based on MFCC and CNNs in this research. The MFCC features image created from the Thai speech procedure is explained. The MFCC image is treated as a normal image. Object detection techniques based on CNNs can be used to detect Thai words in the frequency image. You Only Look Once (YOLO) is selected as the word localizer and classifier due to its performance and accuracy. The airport service scenario is explored in this research in order to obtain the performance of the proposed system. The airport information system is selected for the experiments. Speeches were collected from 60 participants with 50% males and 50% females. Speech images are constructed based on MFCC and labeled for specific Thai keywords. The YOLOv3 and Tiny YOLOv3 were trained and the performance was evaluated. Clearly, Tiny YOLOv3 network is good enough for this experiment. New speech data provided from new 20 participants were used to test the proposed system. Resulting in the proposed ASR system based on MFCC and CNNs has a good performance in both speed and accuracy.\",\"PeriodicalId\":147047,\"journal\":{\"name\":\"2021 Second International Symposium on Instrumentation, Control, Artificial Intelligence, and Robotics (ICA-SYMP)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-01-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 Second International Symposium on Instrumentation, Control, Artificial Intelligence, and Robotics (ICA-SYMP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICA-SYMP50206.2021.9358451\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 Second International Symposium on Instrumentation, Control, Artificial Intelligence, and Robotics (ICA-SYMP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICA-SYMP50206.2021.9358451","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3
摘要
自动语音识别(ASR)更为重要,特别是在冠状病毒爆发期间。本研究提出了基于MFCC和cnn的泰语句子自动识别。介绍了从泰语语音程序中创建的MFCC特征图像。MFCC图像被视为正常图像。基于cnn的目标检测技术可以用于检测频率图像中的泰语单词。由于YOLO (You Only Look Once)的性能和准确性,我们选择它作为单词定位器和分类器。为了获得所提出系统的性能,本研究对机场服务场景进行了探索。实验选择机场信息系统。该研究收集了60名参与者的演讲,其中男性和女性各占50%。基于MFCC构建语音图像并标记特定的泰语关键词。对YOLOv3和Tiny YOLOv3进行训练并评估其性能。显然,Tiny YOLOv3网络对于这个实验来说已经足够好了。来自新20名参与者的新语音数据被用于测试所提出的系统。结果表明,本文提出的基于MFCC和cnn的ASR系统在速度和精度上都有良好的性能。
Automatic Speech Recognition for Thai Sentence based on MFCC and CNNs
An automatic speech recognition (ASR) is more important, especially in the Coronavirus outbreak. ASR for Thai sentence was proposed based on MFCC and CNNs in this research. The MFCC features image created from the Thai speech procedure is explained. The MFCC image is treated as a normal image. Object detection techniques based on CNNs can be used to detect Thai words in the frequency image. You Only Look Once (YOLO) is selected as the word localizer and classifier due to its performance and accuracy. The airport service scenario is explored in this research in order to obtain the performance of the proposed system. The airport information system is selected for the experiments. Speeches were collected from 60 participants with 50% males and 50% females. Speech images are constructed based on MFCC and labeled for specific Thai keywords. The YOLOv3 and Tiny YOLOv3 were trained and the performance was evaluated. Clearly, Tiny YOLOv3 network is good enough for this experiment. New speech data provided from new 20 participants were used to test the proposed system. Resulting in the proposed ASR system based on MFCC and CNNs has a good performance in both speed and accuracy.