Neural mechanisms of face cue predictability and the integration of facial and acoustic cues in native- and nonnative-accented words

IF 2.3 2区心理学 Q1 AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY

Brain and Language Pub Date : 2025-07-26 DOI:10.1016/j.bandl.2025.105621

Daisy Lei , Yuka Tatsumi , Erica Hsieh , Cristal Giorio , Janet G. van Hell

{"title":"Neural mechanisms of face cue predictability and the integration of facial and acoustic cues in native- and nonnative-accented words","authors":"Daisy Lei , Yuka Tatsumi , Erica Hsieh , Cristal Giorio , Janet G. van Hell","doi":"10.1016/j.bandl.2025.105621","DOIUrl":null,"url":null,"abstract":"<div><div>This study examined the integration of face cue and native- and nonnative-accented English speech by manipulating the face cue predictability of a speaker’s accent (predictable: one accent (American-accent or Chinese-accented), not predictable: two accents (American-accented and Chinese-accented). Monolingual listeners were first familiarized with each speaker’s number and type of accent(s). Then, they completed an EEG-recorded auditory go/no-go animal decision task where the no-go items were critical words and nonwords. Listeners saw a face cue (speaker image) before speech onset and concurrently with the speech. Pre-speech ERP results revealed that listeners processed face cues differently based on face cue predictability. Post-speech ERP analyses revealed N400 lexicality effects for native-accented speech, and face cue predictability effects for nonnative-accented speech. No N400 effects were found for an audio-only experiment. This indicates that the monolingual listeners integrate face cues and auditory cues during real-time nonnative-accented speech processing, but not during native-accented speech processing.</div></div>","PeriodicalId":55330,"journal":{"name":"Brain and Language","volume":"269 ","pages":"Article 105621"},"PeriodicalIF":2.3000,"publicationDate":"2025-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Brain and Language","FirstCategoryId":"102","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0093934X25000902","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY","Score":null,"Total":0}

引用次数: 0

Abstract

This study examined the integration of face cue and native- and nonnative-accented English speech by manipulating the face cue predictability of a speaker’s accent (predictable: one accent (American-accent or Chinese-accented), not predictable: two accents (American-accented and Chinese-accented). Monolingual listeners were first familiarized with each speaker’s number and type of accent(s). Then, they completed an EEG-recorded auditory go/no-go animal decision task where the no-go items were critical words and nonwords. Listeners saw a face cue (speaker image) before speech onset and concurrently with the speech. Pre-speech ERP results revealed that listeners processed face cues differently based on face cue predictability. Post-speech ERP analyses revealed N400 lexicality effects for native-accented speech, and face cue predictability effects for nonnative-accented speech. No N400 effects were found for an audio-only experiment. This indicates that the monolingual listeners integrate face cues and auditory cues during real-time nonnative-accented speech processing, but not during native-accented speech processing.

查看原文本刊更多论文

面部线索可预测性的神经机制以及在母语和非母语重音单词中面部和声音线索的整合

本研究通过操纵面部线索对说话者口音的可预测性(可预测的：一种口音（美国口音或中国口音），不可预测的：两种口音（美国口音和中国口音），来检验面部线索与母语和非母语英语口音的整合。单语听众首先熟悉每个说话者的口音数量和类型。然后，他们完成了一项脑电图记录的听觉“去/不去”动物决策任务，其中不去的项目是关键词和非词。听众在演讲开始前和演讲同时看到了面部提示（说话者图像）。言语前ERP结果显示，听者对面部线索的处理基于面部线索的可预测性。言语后ERP分析发现，N400词汇量对母语语音有影响，而对非母语语音有影响。在纯音频实验中没有发现N400效应。这表明单语听者在实时非母语口音语音处理过程中整合了面部线索和听觉线索，而在实时母语口音语音处理过程中则没有。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Brain and Language 医学-神经科学

CiteScore

4.50

自引率

8.00%

发文量

审稿时长

20.5 weeks

期刊介绍： An interdisciplinary journal, Brain and Language publishes articles that elucidate the complex relationships among language, brain, and behavior. The journal covers the large variety of modern techniques in cognitive neuroscience, including functional and structural brain imaging, electrophysiology, cellular and molecular neurobiology, genetics, lesion-based approaches, and computational modeling. All articles must relate to human language and be relevant to the understanding of its neurobiological and neurocognitive bases. Published articles in the journal are expected to have significant theoretical novelty and/or practical implications, and use perspectives and methods from psychology, linguistics, and neuroscience along with brain data and brain measures.