Speech-reading on the lips as a cognitive resource to understand speech in noise.

IF 1.7 4区 医学 Q4 NEUROSCIENCES
Elena Gessa, Chiara Valzolgher, Elena Giovanelli, Massimo Vescovi, Chiara Visentin, Nicola Prodi, Eloise Di Blasi, Viola Sadler, Francesco Pavani
{"title":"Speech-reading on the lips as a cognitive resource to understand speech in noise.","authors":"Elena Gessa, Chiara Valzolgher, Elena Giovanelli, Massimo Vescovi, Chiara Visentin, Nicola Prodi, Eloise Di Blasi, Viola Sadler, Francesco Pavani","doi":"10.1007/s00221-025-07117-5","DOIUrl":null,"url":null,"abstract":"<p><p>In challenging acoustic scenarios, speech processing is often linked to listening effort, which can be described as the balance between cognitive demands and motivation to understand speech. In such conditions, people usually rely on several behavioral strategies to support speech understanding and reduce listening effort (e.g., speech-reading behavior). Still, it is not clear what cognitive mechanisms underlie the use of behavioral strategies for listening. We hypothesized that the cognitive and motivational dimensions of listening effort may also drive speech-reading strategies spontaneously adopted in challenging conditions. Normal-hearing adults (N = 64) performed audiovisual speech-recognition in noise, in combination with a concurrent mnemonic task with low vs. high working memory engagement to set cognitive demands. Motivation was manipulated between-subjects through fixed or performance-related monetary rewards. Speech-reading was tracked with eye-movement, and pupil dilation served as a physiological measure of listening effort, confirming manipulation effectiveness. We found that exerted listening effort intensifies speech-reading behavior, with motivation playing a key role in this behavioral adaptation to enhanced cognitive demands. These findings document the association between internal mental processes and behavioral adaptation in the speech domain.</p>","PeriodicalId":12268,"journal":{"name":"Experimental Brain Research","volume":"243 7","pages":"163"},"PeriodicalIF":1.7000,"publicationDate":"2025-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Experimental Brain Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00221-025-07117-5","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

In challenging acoustic scenarios, speech processing is often linked to listening effort, which can be described as the balance between cognitive demands and motivation to understand speech. In such conditions, people usually rely on several behavioral strategies to support speech understanding and reduce listening effort (e.g., speech-reading behavior). Still, it is not clear what cognitive mechanisms underlie the use of behavioral strategies for listening. We hypothesized that the cognitive and motivational dimensions of listening effort may also drive speech-reading strategies spontaneously adopted in challenging conditions. Normal-hearing adults (N = 64) performed audiovisual speech-recognition in noise, in combination with a concurrent mnemonic task with low vs. high working memory engagement to set cognitive demands. Motivation was manipulated between-subjects through fixed or performance-related monetary rewards. Speech-reading was tracked with eye-movement, and pupil dilation served as a physiological measure of listening effort, confirming manipulation effectiveness. We found that exerted listening effort intensifies speech-reading behavior, with motivation playing a key role in this behavioral adaptation to enhanced cognitive demands. These findings document the association between internal mental processes and behavioral adaptation in the speech domain.

唇读作为一种认知资源来理解噪声环境下的言语。
在具有挑战性的声学场景中,语音处理通常与听力努力有关,这可以被描述为认知需求和理解语音动机之间的平衡。在这种情况下,人们通常依靠几种行为策略来支持言语理解并减少倾听的努力(例如,言语阅读行为)。然而,目前尚不清楚是什么认知机制导致了听力行为策略的使用。我们假设听力努力的认知和动机维度也可能驱动在挑战性条件下自发采用的言语阅读策略。64名听力正常的成年人(N = 64)在噪声环境下进行视听语音识别,并结合低工作记忆和高工作记忆参与的并发记忆任务来设定认知需求。通过固定的或与表现相关的金钱奖励来操纵受试者之间的动机。研究人员通过眼球运动来跟踪语音阅读,瞳孔扩张作为听力努力的生理指标,证实了操作的有效性。我们发现,听力努力增强了言语阅读行为,动机在这种行为适应中起着关键作用。这些发现证明了内部心理过程和言语领域的行为适应之间的联系。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
3.60
自引率
5.00%
发文量
228
审稿时长
1 months
期刊介绍: Founded in 1966, Experimental Brain Research publishes original contributions on many aspects of experimental research of the central and peripheral nervous system. The focus is on molecular, physiology, behavior, neurochemistry, developmental, cellular and molecular neurobiology, and experimental pathology relevant to general problems of cerebral function. The journal publishes original papers, reviews, and mini-reviews.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信