Ying Qin, Yao Qian, Anastassia Loukina, P. Lange, A. Misra, Keelan Evanini, Tan Lee
{"title":"Automatic Detection of Word-Level Reading Errors in Non-native English Speech Based on ASR Output","authors":"Ying Qin, Yao Qian, Anastassia Loukina, P. Lange, A. Misra, Keelan Evanini, Tan Lee","doi":"10.1109/ISCSLP49672.2021.9362102","DOIUrl":null,"url":null,"abstract":"Automated reading error detection has attracted a lot of interest in the area of computer-assisted language learning and auto-mated reading tutors. This paper presents preliminary experimental results on automatic detection of word-level reading errors in non-native speech. A state-of-the-art large vocabulary automatic speech recognition (ASR) system is developed to transcribe non-native speech, with performance comparable to humans in transcribing non-native read speech data. With this ASR system, we investigate the feasibility of detecting substitution, insertion and deletion errors from ASR decoding results on non-native read speech. Experimental results show that the performance of detecting substitution and insertion errors are on the low side. Several possible reasons for causing such results are discussed in this paper. Common types of reading errors occurring in non-native read speech and those that are difficult to be detected are analyzed for future investigation.","PeriodicalId":279828,"journal":{"name":"2021 12th International Symposium on Chinese Spoken Language Processing (ISCSLP)","volume":"68 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-01-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 12th International Symposium on Chinese Spoken Language Processing (ISCSLP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISCSLP49672.2021.9362102","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Automated reading error detection has attracted a lot of interest in the area of computer-assisted language learning and auto-mated reading tutors. This paper presents preliminary experimental results on automatic detection of word-level reading errors in non-native speech. A state-of-the-art large vocabulary automatic speech recognition (ASR) system is developed to transcribe non-native speech, with performance comparable to humans in transcribing non-native read speech data. With this ASR system, we investigate the feasibility of detecting substitution, insertion and deletion errors from ASR decoding results on non-native read speech. Experimental results show that the performance of detecting substitution and insertion errors are on the low side. Several possible reasons for causing such results are discussed in this paper. Common types of reading errors occurring in non-native read speech and those that are difficult to be detected are analyzed for future investigation.