Malsori wa eumseong gwahak最新文献

筛选

英文中文

Building robust Korean speech recognition model by fine-tuning large pretrained model* 通过对大型预训练模型进行微调，构建稳健的韩语语音识别模型*

Malsori wa eumseong gwahak Pub Date : 2023-09-01 DOI: 10.13064/ksss.2023.15.3.075

Changhan Oh, Cheongbin Kim, Kiyoung Park

{"title":"Building robust Korean speech recognition model by fine-tuning large pretrained model*","authors":"Changhan Oh, Cheongbin Kim, Kiyoung Park","doi":"10.13064/ksss.2023.15.3.075","DOIUrl":"https://doi.org/10.13064/ksss.2023.15.3.075","url":null,"abstract":"Automatic speech recognition (ASR) has been revolutionized with deep learning-based approaches, among which self-supervised learning methods have proven to be particularly effective. In this study, we aim to enhance the performance of OpenAI’s Whisper model, a multilingual ASR system on the Korean language. Whisper was pretrained on a large corpus (around 680,000 hours) of web speech data and has demonstrated strong recognition performance for major languages. However, it faces challenges in recognizing languages such as Korean, which is not major language while training. We address this issue by fine-tuning the Whisper model with an additional dataset comprising about 1,000 hours of Korean speech. We also compare its performance against a Transformer model that was trained from scratch using the same dataset. Our results indicate that fine-tuning the Whisper model significantly improved its Korean speech recognition capabilities in terms of character error rate (CER). Specifically, the performance improved with increasing model size. However, the Whisper model’s performance on English deteriorated post fine-tuning, emphasizing the need for further research to develop robust multilingual models. Our study demonstrates the potential of utilizing a fine-tuned Whisper model for Korean ASR applications. Future work will focus on multilingual recognition and optimization for real-time inference.","PeriodicalId":471000,"journal":{"name":"Malsori wa eumseong gwahak","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135687021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

首页上一页