Yukari Hirata, Erica Friedman, Caroline Kaicher, Spencer D. Kelly
{"title":"Multimodal training on L2 Japanese pitch accent: learning outcomes, neural correlates and subjective assessments","authors":"Yukari Hirata, Erica Friedman, Caroline Kaicher, Spencer D. Kelly","doi":"10.1017/langcog.2024.24","DOIUrl":"https://doi.org/10.1017/langcog.2024.24","url":null,"abstract":"Japanese pitch accent is phonemic, making it crucial for second-language learners to acquire. Building on theories of multimodal learning, the present study explored how auditory, visual and gestural training of Japanese pitch accent affected behavioral, neural and meta-cognitive aspects of pitch perception across two experiments. Experiment 1 used a between-subjects pre/posttest design to train native English speakers to perceive Japanese pitch accents in one of the following three conditions: (1) baseline (audio + flat notation), (2) pitch height notation (audio + notation mimicking pitch height) and (3) pitch height notation + a left-hand gesture (L-gesture) (to engage the contralateral right hemisphere specialized for suprasegmental pitch processing). Our results indicated that (2) pitch height notation training was most robust in its benefits, as participants in this condition improved on trained and novel words alike. Experiment 2 used a within-subjects design to extend Experiment 1 in three ways: adding a right-hand gesture (R-gesture) condition (to engage more segmental language areas in the left hemisphere), introducing a neural correlate of cognitive load (measured by EEG alpha and theta power) and performing a metacognitive subjective assessment of learning (e.g., ‘Which training did you find the most helpful?’). The results showed that although there were no differences among our four training conditions on learning outcomes or EEG power, participants made the most positive subjective evaluations about pitch height notation and R-gesture training. Together, the results suggest that there may be a ‘just right’ amount of multimodal instruction to boost learning and increase engagement during foreign language pitch instruction.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142268803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Aseel Zibin, Abdel Rahman Mitib Altakhaineh, Ola Musmar
{"title":"Head metonymies and metaphors in Jordanian and Tunisian Arabic: an extended conceptual metaphor theory perspective","authors":"Aseel Zibin, Abdel Rahman Mitib Altakhaineh, Ola Musmar","doi":"10.1017/langcog.2024.31","DOIUrl":"https://doi.org/10.1017/langcog.2024.31","url":null,"abstract":"This study aims to explore the target concepts of metonymical and metaphorical uses of ‘head’ in Jordanian Arabic (JA) compared to those used in Tunisian Arabic (TA). Extended conceptual metaphor theory (ECMT) as envisaged by Kövecses (2020, <jats:italic>Review of Cognitive Linguistics</jats:italic>, <jats:italic>18</jats:italic>, 112–-130) is adopted as the theoretical framework. Data analysis reveals that through metonymic metaphors, the <jats:italic>head</jats:italic> in JA is used to profile <jats:sc>character traits</jats:sc>, <jats:sc>mental faculty</jats:sc>, <jats:sc>cultural values</jats:sc> and <jats:sc>emotions</jats:sc>. The head in JA is also capitalized upon to provide explanations of several daily life experiences. The primacy of head in JA was clear in the informants’ comprehension of the means by which embodiment provides the grounding for cognition, perception and language, which supports Gibbs’ (2014, <jats:italic>The Bloomsbury companion to cognitive linguistics</jats:italic>, pp. 167–184) ‘embodied metaphorical imagination’. Similarities in the cultural model of <jats:italic>head</jats:italic> between the two dialects were found, yet differences were also detected. In contrast to TA, the head is more productive in JA in profiling <jats:sc>character traits</jats:sc> and <jats:sc>emotions</jats:sc>. These differences were attributed to the existence of a cultural filter that has the ability to function between two cultures that belong to one matrix Arab culture and differences in experiential focus between the two examined speech communities.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217461","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Facial expressions in different communication settings: A case of whispering and speaking with a face mask in Farsi","authors":"Nasim Mahdinazhad Sardhaei, Marzena Żygis, Hamid Sharifzadeh","doi":"10.1017/langcog.2024.21","DOIUrl":"https://doi.org/10.1017/langcog.2024.21","url":null,"abstract":"This study addresses the importance of orofacial gestures and acoustic cues to execute prosodic patterns under different communicative settings in Farsi. Given that Farsi lacks morpho-syntactic markers for polar questions, we aim to determine whether specific facial movements accompany the prosodic correlates of questionhood in Farsi under conditions of degraded information, that is, whispering and wearing face masks. We hypothesise speakers will employ the most pronounced facial expressions when whispering questions with a face mask to compensate for the absence of F0, reduced intensity and lower face invisibility. To this end, we conducted an experiment with 10 Persian speakers producing 10 pairs of statements and questions in normal and whispered speech modes with and without face masks. Our results provide support to our hypotheses that speakers will intensify their orofacial expressions when confronted with marked conditions. We interpreted our results in terms of the ‘<jats:italic>hand in hand</jats:italic>’ and ‘<jats:italic>trade-off’</jats:italic> hypothesis. In whispered speech, the parallel realisation of longer word duration and orofacial expressions may be a compensatory mechanism for the limited options to convey intonation. Also, the lower face coverage is mutually compensated for by word duration and intensified upper facial expressions, all of which in turn support the trade-off hypothesis.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217463","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Melissa K. Jungers, Julie M. Hupp, Jarrett A. Rardon, Samantha A. McDonald, Yujin Song
{"title":"The effect of emotional prosody and referent characteristics on novel noun learning","authors":"Melissa K. Jungers, Julie M. Hupp, Jarrett A. Rardon, Samantha A. McDonald, Yujin Song","doi":"10.1017/langcog.2024.28","DOIUrl":"https://doi.org/10.1017/langcog.2024.28","url":null,"abstract":"Prosody includes the pitch, timing and loudness in speech, which can convey meaning and emotion. This study examines whether prosodic categories affect novel noun learning and whether the referent characteristic influence learning. Previous research showed that emotional prosody interfered with adults’ noun learning (West et al., 2017), but it had no effect on children (West et al., 2022). However, these researchers varied their method across ages, including animacy and complexity of the referent, and it is unclear if the results extend beyond the three emotional prosodies tested. Participants in the current set of studies heard novel words presented in five prosodic categories (within-subject) in order to learn the label for either animate or inanimate objects (between-subject). Study 1 compared inanimate objects and aliens, with better noun learning performance for inanimate objects. Study 2 compared inanimate objects with the same objects with faces added, but there was no difference in noun learning by object type. Both studies showed differences in noun learning by the prosodic category, with warning less accurate than naming. These results demonstrate how extralinguistic factors like prosody, attention and referent complexity influence noun learning.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142217462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Theresa Matzinger, Marek Placiński, Adam Gutowski, Mariusz Lewandowski, Przemysław Żywiczyński, Sławomir Wacewicz
{"title":"Inherent linguistic preference outcompetes incidental alignment in cooperative partner choice","authors":"Theresa Matzinger, Marek Placiński, Adam Gutowski, Mariusz Lewandowski, Przemysław Żywiczyński, Sławomir Wacewicz","doi":"10.1017/langcog.2024.27","DOIUrl":"https://doi.org/10.1017/langcog.2024.27","url":null,"abstract":"An important quality to assess in others is their cooperativeness. We hypothesized that people use linguistic markers in their partners’ speech as a proxy of their cooperativeness in other tasks: specifically, we predicted that participants would prefer syntactically similar conversation partners as cooperation partners in a monetary game. We found that, indeed, participants preferably selected syntactically similar conversation partners as cooperation partners, but only when the participants could communicate using their naturally preferred constructions. In contrast, when participants were forced to communicate using dispreferred constructions, they rather cooperated with those partners that matched their natural preference than with those that matched their overt linguistic use. This pattern of results was likely driven by participants valuing representational alignment (i.e., being aligned on both linguistic features and their mental representations) more than incidental behavioral alignment (i.e., superficial convergence on similar linguistic features during interaction). This is because representational alignment is a potential indicator of group membership and may be associated with in-group benefits such as reputation, reciprocity and normative behavior. Those benefits may outweigh the benefits of simple behavioral alignment, which could be a potential indicator of others’ willingness to cooperate. This has important implications for communication in intercultural settings where members of diverse linguistic groups negotiate cooperative actions.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141772905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"‘This you may NNNNNNEVER have heard before’: initial lengthening of accented negative items as vocal-entangled gestures","authors":"Simon Harrison","doi":"10.1017/langcog.2024.26","DOIUrl":"https://doi.org/10.1017/langcog.2024.26","url":null,"abstract":"Movement scientists have proposed to ground the relation between prosody and gesture in ‘vocal-entangled gestures’, defined as biomechanical linkages between upper limb movement and the respiratory–vocal system. Focusing on spoken language negation, this article identifies an acoustic profile with which gesture is plausibly entangled, specifically linking the articulatory behaviour of onset consonant lengthening with forelimb gesture preparation and facial deformation. This phenomenon was discovered in a video corpus of accented negative utterances from English-language televised dialogues. Eight target examples were selected and examined using visualization software to analyse the correspondence of gesture phase structures (preparation, stroke, holds) with the negation word’s acoustic signal (duration, pitch and intensity). The results show that as syllable–onset consonant lengthens (voiced alveolar /n/ = 300 ms on average) with pitch and intensity increasing (e.g. ‘NNNNNNEVER’), the speaker’s humerus is rotating with palm pronating/adducing while his or her face is distorting. Different facial distortions, furthermore, were found to be entangled with different post-onset phonetic profiles (e.g. vowel rounding). These findings illustrate whole-bodily dynamics and multiscalarity as key theoretical proposals within ecological and enactive approaches to language. Bringing multimodal and entangled treatments of utterances into conversation has important implications for gesture studies.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141194669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Effect of age of first exposure on L2 contextual lexical semantic learning: an ERP investigation","authors":"Shuang Xu, Hailing Wang, Shouxin Li, Guang Ouyang","doi":"10.1017/langcog.2024.29","DOIUrl":"https://doi.org/10.1017/langcog.2024.29","url":null,"abstract":"Age of first exposure (AoFE) is an important factor that influences the quality of L2 acquisition. This study aims to investigate the AoFE effect on the contextual learning of L2 novel words at the neural level, as measured by the N400 component from event-related potentials (ERPs). Eighty-eight participants were recruited for the experiment of L2 pseudoword learning, which includes a learning session and a testing session. The participants’ EEG data were recorded from the testing session, and the N400 effect was derived from target words that were either congruous or incongruous with the context. The linear mixed model and multiple regression model revealed a positive AoFE effect on the N400 effect in discourses that were designed for testing retrieval of episodic and semantic memory even after accounting for the variance contributed by several confounding factors. In addition to AoFE, the effects of total L2 exposure, L2 proficiency and personality on the L2 novel word learning performance indicated by the N400 effect were also confirmed in the statistical results.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141165841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dynamics of English gratitude expression: a corpus-assisted analysis of UK government COVID-19 briefings","authors":"Jilan Wei, M. Lynne Murphy","doi":"10.1017/langcog.2024.25","DOIUrl":"https://doi.org/10.1017/langcog.2024.25","url":null,"abstract":"With a focus on politicians’ and medical experts’ gratitude expressions in UK government COVID-19 briefings, this research describes how perspective and intensity were modulated in expressing gratitude to realise different pragmatic intentions. This corpus-assisted analysis finds that retrospective or prospective gratitude expression was adopted by the two British elite groups to build solidarity (encouraging) and/or make requests (directing) for protecting public health. Gratitude of varying intensities was expressed (e.g. by highlighting metaphorical dimensions such as WIDTH and DEPTH) to correspond to the importance of a benefit (judged by how much the given benefit matches the receiver’s needs and preferences) and/or to implicitly display the evaluation of the benefactor’s responsibility and efforts. We tentatively formulate a dynamic model of gratitude expression in public discourse and shed light on the metaphorical conceptualisation of English gratitude expression and the power of gratitude expression in boosting social cohesion and directing social actions in a discourse of crisis.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140938650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Developments in event conceptualisation and event integration in language and mind","authors":"Jill Hohenstein, Xinyan Kou, Efstathia Soroli","doi":"10.1017/langcog.2024.15","DOIUrl":"https://doi.org/10.1017/langcog.2024.15","url":null,"abstract":"<p>This essay is the introduction to the Special Issue ‘Events in language and mind: Theoretical and empirical advances in the event integration theory’. We first review Leonard Talmy’s event integration theory in addition to some critiques of this framework. Following this, we point to some empirical research inspired by this framework, which explores the interaction between language and cognition. We then briefly introduce the papers in this volume and discuss their contributions to the event integration framework. We conclude with some limitations, questions and future directions.</p>","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140809318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thomas Van Hoey, Xiaoyu Yu, Tung-Le Pan, Youngah Do
{"title":"What ratings and corpus data reveal about the vividness of Mandarin ABB words","authors":"Thomas Van Hoey, Xiaoyu Yu, Tung-Le Pan, Youngah Do","doi":"10.1017/langcog.2024.22","DOIUrl":"https://doi.org/10.1017/langcog.2024.22","url":null,"abstract":"\u0000 A well-known method of studying iconic words is through the collection of subjective ratings. We collected such ratings regarding familiarity, iconicity, imagery/imageability, concreteness, sensory experience rating (SER), valence and arousal for Mandarin ABB words. This is a type of phrasal compound consisting of a prosaic syllable A and a reduplicated BB part, resulting in a vivid phrasal compound, for example, wù-mángmáng 雾茫茫 ‘completely foggy’. The correlations between the newly collected ABB ratings are contrasted with two other sets of prosaic word ratings, demonstrating that variables that characterize ABB words in an absolute sense may not play a distinctive role when contrasted with other types of words. Next, we provide another angle for looking at ABB words, by investigating to what degree rating data converges with corpus data. By far, the variable that characterizes ABB items consistently throughout these case studies is their high score for imageability, showing that they are indeed rightfully characterized as vivid. Methodologically, we show that it pays off to not take rating data at face value but to contrast it with other comparable datasets of a different phenomenon or data about the same phenomenon compiled in an ontologically different manner.","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140670613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}