Prithwijit Roychowdhury, Melissa Castillo-Bustamante, Dhrumi Gandhi, Renata M Knoll, Matthew J Wu, Elliott D Kozin, Aaron K Remenschneider
{"title":"评估COVID-19期间人工耳蜗候选人语音转文本应用的准确性","authors":"Prithwijit Roychowdhury, Melissa Castillo-Bustamante, Dhrumi Gandhi, Renata M Knoll, Matthew J Wu, Elliott D Kozin, Aaron K Remenschneider","doi":"10.1080/14670100.2022.2120450","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Universal mask wearing due to COVID-19 has introduced barriers to clear communication. In hearing impaired individuals this can impact informed surgical consent. For cochlear implant candidates, who do not rely on sign language, real-time transcription with a stenographer (CART) is the gold-standard in assistive technologies. If CART is not available, speech to text (STT) applications have been advertised as solutions, but their transcription accuracy with or without an N95 mask is not well-established. Herein, we sought to investigate the transcription accuracy of three STT solutions for iPhone and compare their performance to the CART service at our institution.</p><p><strong>Methods: </strong>Three native English speakers and three non-native English speakers read two passages (a cochlear implant consent and the non-medical 'Rainbow passage') with and without an N95 mask. Error rates from the comparison of the transcript (from either the STT app or CART) with the original passage were calculated.</p><p><strong>Results: </strong>The CART service had the lowest error rate of all testing conditions (4.79-7.14%). Ava 24/7 (15.0 ± 9.49%) and the iPhone dictation (15.6 ± 6.65%) had significantly lower average error rates than the Live Transcribe (37.7 ± 20.3%) (<i>P</i> < 0.0001) application. Neither the presence of an N95 nor the type of passage had a statistically significant impact on the error rate.</p><p><strong>Conclusion: </strong>CART should be used to augment communication with patients who are hard of hearing. If CART is not available, a STT application such as Ava 24/7 or the native iPhone dictation application may be considered, even in the context of medical terminology.</p>","PeriodicalId":53553,"journal":{"name":"COCHLEAR IMPLANTS INTERNATIONAL","volume":"24 1","pages":"1-5"},"PeriodicalIF":1.4000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Evaluating the accuracy of speech to text applications for cochlear implant candidates during COVID-19.\",\"authors\":\"Prithwijit Roychowdhury, Melissa Castillo-Bustamante, Dhrumi Gandhi, Renata M Knoll, Matthew J Wu, Elliott D Kozin, Aaron K Remenschneider\",\"doi\":\"10.1080/14670100.2022.2120450\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objectives: </strong>Universal mask wearing due to COVID-19 has introduced barriers to clear communication. In hearing impaired individuals this can impact informed surgical consent. For cochlear implant candidates, who do not rely on sign language, real-time transcription with a stenographer (CART) is the gold-standard in assistive technologies. If CART is not available, speech to text (STT) applications have been advertised as solutions, but their transcription accuracy with or without an N95 mask is not well-established. Herein, we sought to investigate the transcription accuracy of three STT solutions for iPhone and compare their performance to the CART service at our institution.</p><p><strong>Methods: </strong>Three native English speakers and three non-native English speakers read two passages (a cochlear implant consent and the non-medical 'Rainbow passage') with and without an N95 mask. Error rates from the comparison of the transcript (from either the STT app or CART) with the original passage were calculated.</p><p><strong>Results: </strong>The CART service had the lowest error rate of all testing conditions (4.79-7.14%). Ava 24/7 (15.0 ± 9.49%) and the iPhone dictation (15.6 ± 6.65%) had significantly lower average error rates than the Live Transcribe (37.7 ± 20.3%) (<i>P</i> < 0.0001) application. Neither the presence of an N95 nor the type of passage had a statistically significant impact on the error rate.</p><p><strong>Conclusion: </strong>CART should be used to augment communication with patients who are hard of hearing. If CART is not available, a STT application such as Ava 24/7 or the native iPhone dictation application may be considered, even in the context of medical terminology.</p>\",\"PeriodicalId\":53553,\"journal\":{\"name\":\"COCHLEAR IMPLANTS INTERNATIONAL\",\"volume\":\"24 1\",\"pages\":\"1-5\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"COCHLEAR IMPLANTS INTERNATIONAL\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/14670100.2022.2120450\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OTORHINOLARYNGOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"COCHLEAR IMPLANTS INTERNATIONAL","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/14670100.2022.2120450","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OTORHINOLARYNGOLOGY","Score":null,"Total":0}
Evaluating the accuracy of speech to text applications for cochlear implant candidates during COVID-19.
Objectives: Universal mask wearing due to COVID-19 has introduced barriers to clear communication. In hearing impaired individuals this can impact informed surgical consent. For cochlear implant candidates, who do not rely on sign language, real-time transcription with a stenographer (CART) is the gold-standard in assistive technologies. If CART is not available, speech to text (STT) applications have been advertised as solutions, but their transcription accuracy with or without an N95 mask is not well-established. Herein, we sought to investigate the transcription accuracy of three STT solutions for iPhone and compare their performance to the CART service at our institution.
Methods: Three native English speakers and three non-native English speakers read two passages (a cochlear implant consent and the non-medical 'Rainbow passage') with and without an N95 mask. Error rates from the comparison of the transcript (from either the STT app or CART) with the original passage were calculated.
Results: The CART service had the lowest error rate of all testing conditions (4.79-7.14%). Ava 24/7 (15.0 ± 9.49%) and the iPhone dictation (15.6 ± 6.65%) had significantly lower average error rates than the Live Transcribe (37.7 ± 20.3%) (P < 0.0001) application. Neither the presence of an N95 nor the type of passage had a statistically significant impact on the error rate.
Conclusion: CART should be used to augment communication with patients who are hard of hearing. If CART is not available, a STT application such as Ava 24/7 or the native iPhone dictation application may be considered, even in the context of medical terminology.
期刊介绍:
Cochlear Implants International was founded as an interdisciplinary, peer-reviewed journal in response to the growing number of publications in the field of cochlear implants. It was designed to meet a need to include scientific contributions from all the disciplines that are represented in cochlear implant teams: audiology, medicine and surgery, speech therapy and speech pathology, psychology, hearing therapy, radiology, pathology, engineering and acoustics, teaching, and communication. The aim was to found a truly interdisciplinary journal, representing the full breadth of the field of cochlear implantation.