Language and Cognition最新文献_第2页

A multimodal approach to polysemy: the senses of touch 多义词的多模式方法：触觉

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-04-23 DOI: 10.1017/langcog.2024.23

Irene Bolumar Martínez, Daniel Alcaraz Carrión, Javier Valenzuela Manzanares

{"title":"A multimodal approach to polysemy: the senses of touch","authors":"Irene Bolumar Martínez, Daniel Alcaraz Carrión, Javier Valenzuela Manzanares","doi":"10.1017/langcog.2024.23","DOIUrl":"https://doi.org/10.1017/langcog.2024.23","url":null,"abstract":"\u0000 This study investigated whether speakers use multimodal information (speech and gesture) to differentiate the physical and emotional meanings of the polysemous verb touch. We analyzed 302 hand gestures that co-occurred with this perception verb. For each case, we annotated (1) the meaning of touch (physical vs. emotional), (2) the gesture referent speakers physically touched (other-touch vs. self-touch), (3) the personal pronoun following the verb and (4) if they used intensifiers and negation. There were three main findings. First, we have seen that when speakers express the physical meaning, they are likely to reach an external referent (other-touch), but when they imply the emotional meaning, they tend to touch their own body (self-touch). Second, the most frequent co-speech gesture (chest-touching gesture) was associated with the emotional meaning, uncovering the metaphor the heart is container for emotions. Third, this study showed that the physical meaning of touch usually coexists with a wide variety of personal pronouns and negation words; in contrast, the emotional meaning of touch occurs primarily with the pronoun me and it is usually modified by intensifiers. Thus, speakers use both speech and gesture to differentiate the meanings of the polysemous verb touch.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140666521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-04-19 DOI: 10.1017/langcog.2024.20

Maryam A. AlJassmi, Manuel Perea

引用次数: 0

The organization of semantic associations between senses in language 语言中感官之间的语义关联组织

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-04-18 DOI: 10.1017/langcog.2024.19

Jorge A. Alvarado, Carlos Velasco, Alejandro Salgado

{"title":"The organization of semantic associations between senses in language","authors":"Jorge A. Alvarado, Carlos Velasco, Alejandro Salgado","doi":"10.1017/langcog.2024.19","DOIUrl":"https://doi.org/10.1017/langcog.2024.19","url":null,"abstract":"Distributional semantic representations were used to investigate crossmodal correspondences within language, offering a comprehensive analysis of how sensory experiences interconnect in linguistic constructs. By computing semantic proximity between words from different sensory modalities, a crossmodal semantic network was constructed, providing a general view of crossmodal correspondences in the English language. Community detection techniques were applied to unveil domains of experience where crossmodal correspondences were likely to manifest, while also considering the role of affective dimensions in shaping these domains. The study revealed the existence of an architecture of structured domains of experience in language, whereby crossmodal correspondences are deeply embedded. The present research highlights the roles of emotion and statistical associations in the organization of sensory concepts across modalities in language. The domains identified, including food, the body, the physical world and emotions/values, underscored the intricate interplay between the senses, emotion and semantic patterns. These findings align with the embodied lexicon hypothesis and the semantic coding hypothesis, emphasizing the capacity of language to capture and reflect crossmodal correspondences’ emotional and perceptual subtleties in the form of networks, while also revealing opportunities for further perceptual research on crossmodal correspondences and multisensory integration.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140616271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A mathematical model of semantic access in lexical and semantic decisions 词汇和语义决策中语义访问的数学模型

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-04-11 DOI: 10.1017/langcog.2024.17

Sergio E. Chaigneau, Nicolás Marchant, Enrique Canessa, Nerea Aldunate

引用次数: 0

About the same thing in a different way: wording and experienced emotions in the understanding of official letters 以不同的方式看待同一件事：理解公文中的措辞和经验情感

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-04-11 DOI: 10.1017/langcog.2024.14

Marta M. Jankowska, Kamil K. Imbir

{"title":"About the same thing in a different way: wording and experienced emotions in the understanding of official letters","authors":"Marta M. Jankowska, Kamil K. Imbir","doi":"10.1017/langcog.2024.14","DOIUrl":"https://doi.org/10.1017/langcog.2024.14","url":null,"abstract":"Reading official letters and being able to react to them appropriately is part of the daily life of every adult in many countries. Although the history of the plain language movement dates to the past century, it is only now that efforts are being made in Poland to adapt official documents to their audience. In this paper, we describe the results of a study (N = 685) in which we examined how particular linguistic forms and text structure affect the reception of an official-looking text – comprehension as well as emotions experienced, trust in the office, feelings of helplessness in the situation of reading the writing, and many other variables. Based on Imbir’s (2016, New Ideas in Psychology, 43, 39–49), two-system theory of emotions, we aim to examine how emotions – triggered by these complex stimuli – affect their processing. We hope that the results of our interdisciplinary research will answer the questions and hypotheses posed by researchers and find application in the reforms currently underway. We believe that by linking findings from cognitive psychology, the psychology of emotions and linguistics, we will also expand knowledge in the broad discussion on overcoming barriers between administrative offices and target audiences.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140564833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Exploring conceptual representation and grounding through perceptual strength norms in deaf individuals 通过聋人的知觉强度规范探索概念表征和基础

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-04-08 DOI: 10.1017/langcog.2024.13

Simona Amenta, Giulia Loca, Gabriele Gianfreda, Pasquale Rinaldi, Francesco Pavani

{"title":"Exploring conceptual representation and grounding through perceptual strength norms in deaf individuals","authors":"Simona Amenta, Giulia Loca, Gabriele Gianfreda, Pasquale Rinaldi, Francesco Pavani","doi":"10.1017/langcog.2024.13","DOIUrl":"https://doi.org/10.1017/langcog.2024.13","url":null,"abstract":"In this study, our objective was to explore the impact of hearing loss on the conceptual system underlying word meaning. We collected perceptual strength norms for 200 Italian words from early deaf individuals with limited or no access to auditory information and compared them to existing norms from hearing individuals. For each word, participants provided perceptual strength ratings for each perceptual modality. Our results revealed a significant reduction of the auditory modality in the norms provided by deaf individuals compared to the hearing population. However, we did not observe an overall decrease in reported perceptual strength. Interestingly, we found a heightened involvement of other sensory modalities accompanied by reduced modality exclusivity in the conceptualization of words, indicating that deaf individuals heavily rely on information coming from the other perceptual modalities to form concepts. These findings suggest that hearing loss leads to a reorganisation of word conceptualization, characterised by increased multisensoriality. Importantly, although diminished, the auditory modality remains present, suggesting that deaf individuals can still infer auditory-associated knowledge about words to some extent.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140565035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuli 视觉通道有助于理解巴西葡萄牙语wh-questions和wh-exclamations的语调：来自一致和不一致刺激的证据

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-04-08 DOI: 10.1017/langcog.2024.16

Luma da Silva Miranda, João Antônio de Moraes, Albert Rilliard

{"title":"Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuli","authors":"Luma da Silva Miranda, João Antônio de Moraes, Albert Rilliard","doi":"10.1017/langcog.2024.16","DOIUrl":"https://doi.org/10.1017/langcog.2024.16","url":null,"abstract":"This paper presents an audiovisual perceptual analysis of the wh-question and wh-exclamation intonation in Brazilian Portuguese using auditory–visual congruent and incongruent stimuli, to investigate the relative importance of each modality in signaling pragmatic meanings. Ten Brazilian Portuguese speakers (five female) were filmed while producing both speech acts 10 times. Next, artificial stimuli were created: audio and visual cues were either matched (audio and video from the same speech act) or mismatched (audio and video from the different speech acts), resulting in 10 congruent and 10 incongruent stimuli of the wh-questions and the wh-exclamations. The perceptual experiment was taken by 36 Brazilians who identified the stimulus as a question or an exclamation. Results from the logistic regression showed that the factor ‘congruence’ was significant and had a significant interaction with ‘speakers’, which means that the congruent stimuli increased the comprehension of the Brazilian Portuguese wh-questions and wh-exclamations. In contrast, the incongruent stimuli tended to lower listeners’ identification, but to a degree depending on individual speakers’ strategies. Although variation in the accuracy of expressing both speech acts was also found across speakers, this study corroborates that the visual channel impacts the perceptual identification of the pragmatic intonation function of distinguishing sentence mode.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140565209","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Are schematic diagrams valid visual representations of concepts? Evidence from mental imagery in online processing of English prepositions 示意图是有效的概念视觉表征吗？英语介词在线处理中的心理想象证据

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-04-02 DOI: 10.1017/langcog.2024.18

Menghan Wang, Helen Zhao

{"title":"Are schematic diagrams valid visual representations of concepts? Evidence from mental imagery in online processing of English prepositions","authors":"Menghan Wang, Helen Zhao","doi":"10.1017/langcog.2024.18","DOIUrl":"https://doi.org/10.1017/langcog.2024.18","url":null,"abstract":"Embodied imagery hypothesis proposes the activation of perceptual-motor systems during language processing. Previous studies primarily used concrete visual stimuli to investigate mental imagery in language processing by native speakers (NSs) and second language (L2) learners, but few studies employed schematic diagrams. The study aims to investigate mental imagery in processing prepositional phrases by English NSs and L2 learners. Using image-schematic diagrams as primes, we examine whether any mental imagery effect is modulated by target preposition (over, in), the abstractness of meaning (spatial, extended), and stimulus onset asynchrony (SOA; 1,040 ms, 2,040 ms). A total of 79 adult L2 learners and 100 NSs of English completed diagram–picture matching and semantic priming phrasal decision tasks. Results revealed interference effects on L2 processing of over phrases and under 2,040 ms SOA, but no such effects were observed in the NS group. The selective interference effects in L2 suggest different mental imagery patterns between L1 and L2 processing, and processing schematic diagram primes requires high cognitive demands, potentially leading to difficulties in integrating visual and linguistic information and making grammaticality judgments. The findings partially validate schematic diagrams as visual representations of concepts and suggest the need for further examination of schematic diagrams with varying degrees of complexity.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140565017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Praxis, demonstration and pantomime: a motion capture investigation of differences in action performances 实践、示范和哑剧：动作表演差异的动作捕捉研究

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-04-02 DOI: 10.1017/langcog.2024.8

Przemysław Żywiczyński, Marek Placiński, Marta Sibierska, Monika Boruta-Żywiczyńska, Sławomir Wacewicz, Michał Meina, Peter Gärdenfors

引用次数: 0

Semantic differences in visually similar face emojis 视觉上相似的人脸表情符号的语义差异

IF 1.8 3区心理学

Language and Cognition Pub Date : 2024-03-26 DOI: 10.1017/langcog.2024.12

Lea Fricke, Patrick G. Grosz, Tatjana Scheffler

{"title":"Semantic differences in visually similar face emojis","authors":"Lea Fricke, Patrick G. Grosz, Tatjana Scheffler","doi":"10.1017/langcog.2024.12","DOIUrl":"https://doi.org/10.1017/langcog.2024.12","url":null,"abstract":"The literature on face emojis raises the central question whether they should be treated as pictures or conventionalized signals. Our experiment addresses this question by investigating semantic differences in visually similar face emojis. We test a prediction following from a pictorial approach: small visual features of emojis that do not correspond to human facial features should be semantically less relevant than features that represent aspects of facial expressions. We compare emoji pairs with a visual difference that either does or does not correspond to a difference in a human facial expression according to an adaptation of the Facial Action Coding System. We created two contexts per pair, each fitted to correspond to a prominent meaning of one or the other emoji. Participants had to choose a suitable emoji for each context. The rate at which the context-matching emoji was chosen was significantly above chance for both types of emoji pairs and it did not differ significantly between them. Our results show that the small differences are meaningful in all pairs whether or not they correspond to human facial differences. This supports a lexicalist approach to emoji semantics, which treats face emojis as conventionalized signals rather than mere pictures of faces.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140302434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0