{"title":"Imperfect Captions Paired to Audiovisual Stimuli Improve Speech Recognition but Do Not Reduce Listening-Related Fatigue.","authors":"Katie Esser, Erin M Picou, Benjamin W Y Hornsby","doi":"10.1044/2025_AJA-25-00018","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Understanding speech in challenging environments can be fatiguing for individuals with and without hearing loss. Empirical research examining interventions to reduce such fatigue, however, is limited. Our study investigated the effects of imperfect captions, such as those created using automated speech recognition systems, on listening-related fatigue during a challenging speech task.</p><p><strong>Method: </strong>Twenty-two adults (aged 18-63 years) with essentially normal hearing completed a sustained dual task designed to induce listening-related fatigue. The primary task was audiovisual sentence recognition in quiet, with speech levels individually adjusted for ~70% correct performance (without captions). The secondary task was response time (RT) to topic words presented during the speech task. Participants completed the dual task with or without captions. Subjective fatigue ratings were obtained before, during, and after the dual task. Vigilant attention was measured via the secondary task and before and after the dual task using visual stimuli (RTs to a visual marker presented at random intervals).</p><p><strong>Results: </strong>Subjective fatigue ratings increased significantly over the course of the dual task. However, this increase was larger for the group who had captions, even though they had better sentence recognition overall. Evidence of behavioral fatigue (slowed RTs over time) was also present but only for those in the Caption group. Anecdotal reports from study participants suggest that the increased fatigue for the Caption group was related to the cognitive challenge of combining information from the time-locked audiovisual cues and the time-delayed, and imperfect, text captions.</p><p><strong>Conclusions: </strong>Even though they were time-delayed and contained inaccuracies, captions improved speech recognition. However, this benefit was accompanied by greater increases in subjective and behavioral fatigue. Therefore, in some conditions imperfect captions can have negative consequences for listening-related fatigue. Further research is needed to determine whether this pattern holds in different circumstances, such as with audio-only stimuli.</p><p><strong>Supplemental material: </strong>https://doi.org/10.23641/asha.29646482.</p>","PeriodicalId":49241,"journal":{"name":"American Journal of Audiology","volume":" ","pages":"661-675"},"PeriodicalIF":1.8000,"publicationDate":"2025-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12418375/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American Journal of Audiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1044/2025_AJA-25-00018","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/8/13 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Understanding speech in challenging environments can be fatiguing for individuals with and without hearing loss. Empirical research examining interventions to reduce such fatigue, however, is limited. Our study investigated the effects of imperfect captions, such as those created using automated speech recognition systems, on listening-related fatigue during a challenging speech task.
Method: Twenty-two adults (aged 18-63 years) with essentially normal hearing completed a sustained dual task designed to induce listening-related fatigue. The primary task was audiovisual sentence recognition in quiet, with speech levels individually adjusted for ~70% correct performance (without captions). The secondary task was response time (RT) to topic words presented during the speech task. Participants completed the dual task with or without captions. Subjective fatigue ratings were obtained before, during, and after the dual task. Vigilant attention was measured via the secondary task and before and after the dual task using visual stimuli (RTs to a visual marker presented at random intervals).
Results: Subjective fatigue ratings increased significantly over the course of the dual task. However, this increase was larger for the group who had captions, even though they had better sentence recognition overall. Evidence of behavioral fatigue (slowed RTs over time) was also present but only for those in the Caption group. Anecdotal reports from study participants suggest that the increased fatigue for the Caption group was related to the cognitive challenge of combining information from the time-locked audiovisual cues and the time-delayed, and imperfect, text captions.
Conclusions: Even though they were time-delayed and contained inaccuracies, captions improved speech recognition. However, this benefit was accompanied by greater increases in subjective and behavioral fatigue. Therefore, in some conditions imperfect captions can have negative consequences for listening-related fatigue. Further research is needed to determine whether this pattern holds in different circumstances, such as with audio-only stimuli.
期刊介绍：
Mission: AJA publishes peer-reviewed research and other scholarly articles pertaining to clinical audiology methods and issues, and serves as an outlet for discussion of related professional and educational issues and ideas. The journal is an international outlet for research on clinical research pertaining to screening, diagnosis, management and outcomes of hearing and balance disorders as well as the etiologies and characteristics of these disorders. The clinical orientation of the journal allows for the publication of reports on audiology as implemented nationally and internationally, including novel clinical procedures, approaches, and cases. AJA seeks to advance evidence-based practice by disseminating the results of new studies as well as providing a forum for critical reviews and meta-analyses of previously published work.
Scope: The broad field of clinical audiology, including audiologic/aural rehabilitation; balance and balance disorders; cultural and linguistic diversity; detection, diagnosis, prevention, habilitation, rehabilitation, and monitoring of hearing loss; hearing aids, cochlear implants, and hearing-assistive technology; hearing disorders; lifespan perspectives on auditory function; speech perception; and tinnitus.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
