共同语音手势用于预测即将到来的意思。

IF 4.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY
Psychological Science Pub Date : 2025-04-01 Epub Date: 2025-04-22 DOI:10.1177/09567976251331041
Marlijn Ter Bekke, Linda Drijvers, Judith Holler
{"title":"共同语音手势用于预测即将到来的意思。","authors":"Marlijn Ter Bekke, Linda Drijvers, Judith Holler","doi":"10.1177/09567976251331041","DOIUrl":null,"url":null,"abstract":"<p><p>In face-to-face conversation, people use speech and gesture to convey meaning. Seeing gestures alongside speech facilitates comprehenders' language processing, but crucially, the mechanisms underlying this facilitation remain unclear. We investigated whether comprehenders use the semantic information in gestures, typically preceding related speech, to predict upcoming meaning. Dutch adults listened to questions asked by a virtual avatar. Questions were accompanied by an iconic gesture (e.g., typing) or meaningless control movement (e.g., arm scratch) followed by a short pause and target word (e.g., \"type\"). A Cloze experiment showed that gestures improved explicit predictions of upcoming target words. Moreover, an EEG experiment showed that gestures reduced alpha and beta power during the pause, indicating anticipation, and reduced N400 amplitudes, demonstrating facilitated semantic processing. Thus, comprehenders use iconic gestures to predict upcoming meaning. Theories of linguistic prediction should incorporate communicative bodily signals as predictive cues to capture how language is processed in face-to-face interaction.</p>","PeriodicalId":20745,"journal":{"name":"Psychological Science","volume":"36 4","pages":"237-248"},"PeriodicalIF":4.8000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Co-Speech Hand Gestures Are Used to Predict Upcoming Meaning.\",\"authors\":\"Marlijn Ter Bekke, Linda Drijvers, Judith Holler\",\"doi\":\"10.1177/09567976251331041\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>In face-to-face conversation, people use speech and gesture to convey meaning. Seeing gestures alongside speech facilitates comprehenders' language processing, but crucially, the mechanisms underlying this facilitation remain unclear. We investigated whether comprehenders use the semantic information in gestures, typically preceding related speech, to predict upcoming meaning. Dutch adults listened to questions asked by a virtual avatar. Questions were accompanied by an iconic gesture (e.g., typing) or meaningless control movement (e.g., arm scratch) followed by a short pause and target word (e.g., \\\"type\\\"). A Cloze experiment showed that gestures improved explicit predictions of upcoming target words. Moreover, an EEG experiment showed that gestures reduced alpha and beta power during the pause, indicating anticipation, and reduced N400 amplitudes, demonstrating facilitated semantic processing. Thus, comprehenders use iconic gestures to predict upcoming meaning. Theories of linguistic prediction should incorporate communicative bodily signals as predictive cues to capture how language is processed in face-to-face interaction.</p>\",\"PeriodicalId\":20745,\"journal\":{\"name\":\"Psychological Science\",\"volume\":\"36 4\",\"pages\":\"237-248\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2025-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Psychological Science\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1177/09567976251331041\",\"RegionNum\":1,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/4/22 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological Science","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/09567976251331041","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/22 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

在面对面的交谈中,人们用语言和手势来传达意思。在说话的同时看到手势有助于理解者的语言处理,但关键是,这种促进的机制尚不清楚。我们调查了理解者是否使用手势中的语义信息,特别是在相关言语之前,来预测即将到来的意思。荷兰成年人听着虚拟化身提出的问题。在回答问题时,他们会做出一个标志性的手势(比如打字)或无意义的控制动作(比如抓胳膊),然后是短暂的停顿和目标单词(比如“打字”)。完形填空实验表明,手势可以提高对即将到来的目标单词的明确预测。此外,一项脑电图实验表明,手势在暂停期间降低了α和β功率,表明预期,并降低了N400振幅,表明促进了语义加工。因此,理解者使用标志性的手势来预测即将到来的意义。语言预测理论应该结合交际身体信号作为预测线索,以捕捉语言在面对面互动中是如何处理的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Co-Speech Hand Gestures Are Used to Predict Upcoming Meaning.

In face-to-face conversation, people use speech and gesture to convey meaning. Seeing gestures alongside speech facilitates comprehenders' language processing, but crucially, the mechanisms underlying this facilitation remain unclear. We investigated whether comprehenders use the semantic information in gestures, typically preceding related speech, to predict upcoming meaning. Dutch adults listened to questions asked by a virtual avatar. Questions were accompanied by an iconic gesture (e.g., typing) or meaningless control movement (e.g., arm scratch) followed by a short pause and target word (e.g., "type"). A Cloze experiment showed that gestures improved explicit predictions of upcoming target words. Moreover, an EEG experiment showed that gestures reduced alpha and beta power during the pause, indicating anticipation, and reduced N400 amplitudes, demonstrating facilitated semantic processing. Thus, comprehenders use iconic gestures to predict upcoming meaning. Theories of linguistic prediction should incorporate communicative bodily signals as predictive cues to capture how language is processed in face-to-face interaction.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Psychological Science
Psychological Science PSYCHOLOGY, MULTIDISCIPLINARY-
CiteScore
13.30
自引率
0.00%
发文量
156
期刊介绍: Psychological Science, the flagship journal of The Association for Psychological Science (previously the American Psychological Society), is a leading publication in the field with a citation ranking/impact factor among the top ten worldwide. It publishes authoritative articles covering various domains of psychological science, including brain and behavior, clinical science, cognition, learning and memory, social psychology, and developmental psychology. In addition to full-length articles, the journal features summaries of new research developments and discussions on psychological issues in government and public affairs. "Psychological Science" is published twelve times annually.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信