Impact of High- and Low-Pass Acoustic Filtering on Audiovisual Speech Redundancy and Benefit in Children.

IF 2.6 2区 医学 Q1 AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY
Kaylah Lalonde, Grace Dwyer, Adam Bosen, Abby Pitts
{"title":"Impact of High- and Low-Pass Acoustic Filtering on Audiovisual Speech Redundancy and Benefit in Children.","authors":"Kaylah Lalonde, Grace Dwyer, Adam Bosen, Abby Pitts","doi":"10.1097/AUD.0000000000001622","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>To investigate the influence of frequency-specific audibility on audiovisual benefit in children, this study examined the impact of high- and low-pass acoustic filtering on auditory-only and audiovisual word and sentence recognition in children with typical hearing. Previous studies show that visual speech provides greater access to consonant place of articulation than other consonant features and that low-pass filtering has a strong impact on perception on acoustic consonant place of articulation. This suggests visual speech may be particularly useful when acoustic speech is low-pass filtered because it provides complementary information about consonant place of articulation. Therefore, we hypothesized that audiovisual benefit would be greater for low-pass filtered words than high-pass filtered speech. We assessed whether this pattern of results would translate to sentence recognition.</p><p><strong>Design: </strong>Children with typical hearing completed auditory-only and audiovisual tests of consonant-vowel-consonant word and sentence recognition across conditions differing in acoustic frequency content: a low-pass filtered condition in which children could only access acoustic content below 2 kHz and a high-pass filtered condition in which children could only access acoustic content above 2 kHz. They also completed a visual-only test of consonant-vowel-consonant word recognition. We analyzed word, consonant, and keyword-in-sentence recognition and consonant feature (place, voice/manner of articulation) transmission accuracy across modalities and filter conditions using binomial general linear mixed models. To assess the degree to which visual speech is complementary versus redundant with acoustic speech, we calculated the proportion of auditory-only target and response consonant pairs that we can tell apart using only visual speech and compared these values between high-pass and low-pass filter conditions.</p><p><strong>Results: </strong>In auditory-only conditions, recognition accuracy was lower for low-pass filtered consonants and consonant features than high-pass filtered consonants and consonant features, especially consonant place of articulation. In visual-only conditions, recognition accuracy was greater for consonant place of articulation than consonant voice/manner of articulation. In addition, auditory consonants in the low-pass filtered condition were more likely to be substituted for visually distinct consonants, meaning that there was more opportunity to use visual cues to supplement missing auditory information in the low-pass filtered condition. Audiovisual benefit for isolated whole words was greater for low-pass filtered speech than high-pass filtered speech. No difference in audiovisual benefit between filter conditions was observed for phonemes, features, or words-in-sentences. Ceiling effects limit the interpretation of these nonsignificant interactions.</p><p><strong>Conclusions: </strong>For isolated word recognition, visual speech is more complementary with the acoustic speech cues children can access when high-frequency acoustic content is eliminated by low-pass filtering than when low-frequency acoustic content is eliminated by high-pass filtering. This decreased auditory-visual phonetic redundancy is accompanied by larger audiovisual benefit. In contrast, audiovisual benefit for sentence recognition did not differ between low-pass and high-pass filtered speech. This might reflect ceiling effects in audiovisual conditions or a decrease in the contribution of auditory-visual phonetic redundancy to explaining audiovisual benefit for connected speech. These results from children with typical hearing suggest that some variance in audiovisual benefit among children who are hard of hearing may depend in part on frequency-specific audibility.</p>","PeriodicalId":55172,"journal":{"name":"Ear and Hearing","volume":" ","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2024-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ear and Hearing","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/AUD.0000000000001622","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives: To investigate the influence of frequency-specific audibility on audiovisual benefit in children, this study examined the impact of high- and low-pass acoustic filtering on auditory-only and audiovisual word and sentence recognition in children with typical hearing. Previous studies show that visual speech provides greater access to consonant place of articulation than other consonant features and that low-pass filtering has a strong impact on perception on acoustic consonant place of articulation. This suggests visual speech may be particularly useful when acoustic speech is low-pass filtered because it provides complementary information about consonant place of articulation. Therefore, we hypothesized that audiovisual benefit would be greater for low-pass filtered words than high-pass filtered speech. We assessed whether this pattern of results would translate to sentence recognition.

Design: Children with typical hearing completed auditory-only and audiovisual tests of consonant-vowel-consonant word and sentence recognition across conditions differing in acoustic frequency content: a low-pass filtered condition in which children could only access acoustic content below 2 kHz and a high-pass filtered condition in which children could only access acoustic content above 2 kHz. They also completed a visual-only test of consonant-vowel-consonant word recognition. We analyzed word, consonant, and keyword-in-sentence recognition and consonant feature (place, voice/manner of articulation) transmission accuracy across modalities and filter conditions using binomial general linear mixed models. To assess the degree to which visual speech is complementary versus redundant with acoustic speech, we calculated the proportion of auditory-only target and response consonant pairs that we can tell apart using only visual speech and compared these values between high-pass and low-pass filter conditions.

Results: In auditory-only conditions, recognition accuracy was lower for low-pass filtered consonants and consonant features than high-pass filtered consonants and consonant features, especially consonant place of articulation. In visual-only conditions, recognition accuracy was greater for consonant place of articulation than consonant voice/manner of articulation. In addition, auditory consonants in the low-pass filtered condition were more likely to be substituted for visually distinct consonants, meaning that there was more opportunity to use visual cues to supplement missing auditory information in the low-pass filtered condition. Audiovisual benefit for isolated whole words was greater for low-pass filtered speech than high-pass filtered speech. No difference in audiovisual benefit between filter conditions was observed for phonemes, features, or words-in-sentences. Ceiling effects limit the interpretation of these nonsignificant interactions.

Conclusions: For isolated word recognition, visual speech is more complementary with the acoustic speech cues children can access when high-frequency acoustic content is eliminated by low-pass filtering than when low-frequency acoustic content is eliminated by high-pass filtering. This decreased auditory-visual phonetic redundancy is accompanied by larger audiovisual benefit. In contrast, audiovisual benefit for sentence recognition did not differ between low-pass and high-pass filtered speech. This might reflect ceiling effects in audiovisual conditions or a decrease in the contribution of auditory-visual phonetic redundancy to explaining audiovisual benefit for connected speech. These results from children with typical hearing suggest that some variance in audiovisual benefit among children who are hard of hearing may depend in part on frequency-specific audibility.

高低通滤波对儿童视听语音冗余及效益的影响。
目的:为了探讨频率特异性可听性对儿童视听效益的影响,本研究考察了高通和低通声学滤波对典型听力儿童纯听觉和视听单词和句子识别的影响。以往的研究表明,视觉语音比其他辅音特征提供了更多的辅音发音位置,低通滤波对声学辅音发音位置的感知有很强的影响。这表明,当声学语音经过低通过滤时,视觉语音可能特别有用,因为它提供了有关辅音发音位置的补充信息。因此,我们假设低通滤波单词比高通滤波语音的视听效益更大。我们评估了这种结果模式是否可以转化为句子识别。设计:听力正常的儿童在不同的声学频率内容条件下完成辅音-元音-辅音单词和句子识别的纯听觉和视听测试:在低通过滤条件下,儿童只能访问低于2khz的声学内容,在高通过滤条件下,儿童只能访问高于2khz的声学内容。他们还完成了辅音-元音-辅音单词识别的视觉测试。我们使用二项一般线性混合模型分析了单词、辅音和关键字在句子中的识别和辅音特征(地点、声音/发音方式)在模态和过滤条件下的传输准确性。为了评估视觉语音与声学语音互补或冗余的程度,我们计算了仅使用视觉语音就可以区分的听觉目标和响应辅音对的比例,并在高通和低通滤波器条件下比较了这些值。结果:在纯听觉条件下,低通过滤辅音和辅音特征的识别准确率低于高通过滤辅音和辅音特征,尤其是辅音发音位置。在视觉条件下,对辅音发音位置的识别准确率高于辅音发音/发音方式。此外,低通过滤条件下的听觉辅音更有可能被视觉上不同的辅音所取代,这意味着在低通过滤条件下有更多的机会使用视觉线索来补充缺失的听觉信息。低通滤波后的语音比高通滤波后的语音对孤立的整词的视听效果更大。在音素、特征或句子中的单词方面,不同的过滤条件在视听效果上没有差别。天花板效应限制了对这些无关紧要的相互作用的解释。结论:对于孤立词识别,低通滤波去除高频声学内容比高通滤波去除低频声学内容更能与儿童获得的声学语音线索形成互补。这种减少的视听语音冗余伴随着更大的视听效益。相比之下,低通和高通滤波语音对句子识别的视听效益没有差异。这可能反映了视听条件下的天花板效应,或者是视听语音冗余对解释连接语音的视听效益的贡献减少。这些典型听力儿童的结果表明,听力困难儿童在视听方面的一些差异可能部分取决于特定频率的可听性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Ear and Hearing
Ear and Hearing 医学-耳鼻喉科学
CiteScore
5.90
自引率
10.80%
发文量
207
审稿时长
6-12 weeks
期刊介绍: From the basic science of hearing and balance disorders to auditory electrophysiology to amplification and the psychological factors of hearing loss, Ear and Hearing covers all aspects of auditory and vestibular disorders. This multidisciplinary journal consolidates the various factors that contribute to identification, remediation, and audiologic and vestibular rehabilitation. It is the one journal that serves the diverse interest of all members of this professional community -- otologists, audiologists, educators, and to those involved in the design, manufacture, and distribution of amplification systems. The original articles published in the journal focus on assessment, diagnosis, and management of auditory and vestibular disorders.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信