Ell Wilding, Bodo Winter, Jeannette Littlemore, Marcus Perlman
{"title":"标志性的词语与标志性的手势相关联","authors":"Ell Wilding, Bodo Winter, Jeannette Littlemore, Marcus Perlman","doi":"10.1111/cogs.70098","DOIUrl":null,"url":null,"abstract":"<p>Iconicity ratings studies have established that there are many English words which native speakers judge as “iconic,” that is, as sounding like what they mean. Here, we explore whether these iconic English words are more likely to be accompanied by iconic gestures. We report a large-scale quantitative study comparing the gesture rate of words rated as high in iconicity (e.g., <i>swoosh</i>, <i>puffy</i>, <i>crispy</i>) to those rated as low in iconicity (e.g., <i>ordain</i>, <i>rejoin</i>, <i>grateful</i>), balancing for perceptual strength, part-of-speech, and syllable length. Five thousand seven hundred and twenty-five tokens from the TV News Archive were coded for whether speakers produced a gesture with the word, and whether the gesture was iconic. The results show that high iconicity words have a higher overall gesture rate (69%) than low iconicity words (56%): specifically, high iconicity words have a higher <i>iconic</i> gesture rate (24% vs. 11%). This effect is more pronounced among verbs than adjectives, which we hypothesize may be due to the dynamic nature of verbs. We also find that this result persists when controlling for perceptual and action strength ratings, suggesting that word-level iconicity is a more important predictor than sensorimotor strength of whether a speaker will use an iconic gesture. We find that some high iconicity words are more likely to occur with iconic gestures when they come with markers of syntactic isolation, suggesting that morphosyntactic behavior is also relevant to iconic gesture production. Our findings demonstrate that iconicity in spoken communication is inherently multimodal, manifesting in both speech and gesture simultaneously, and that iconicity is often psychologically active when speakers use conventionalized iconic words.</p>","PeriodicalId":48349,"journal":{"name":"Cognitive Science","volume":"49 8","pages":""},"PeriodicalIF":2.4000,"publicationDate":"2025-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/cogs.70098","citationCount":"0","resultStr":"{\"title\":\"Iconic Words Are Associated With Iconic Gestures\",\"authors\":\"Ell Wilding, Bodo Winter, Jeannette Littlemore, Marcus Perlman\",\"doi\":\"10.1111/cogs.70098\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Iconicity ratings studies have established that there are many English words which native speakers judge as “iconic,” that is, as sounding like what they mean. Here, we explore whether these iconic English words are more likely to be accompanied by iconic gestures. We report a large-scale quantitative study comparing the gesture rate of words rated as high in iconicity (e.g., <i>swoosh</i>, <i>puffy</i>, <i>crispy</i>) to those rated as low in iconicity (e.g., <i>ordain</i>, <i>rejoin</i>, <i>grateful</i>), balancing for perceptual strength, part-of-speech, and syllable length. Five thousand seven hundred and twenty-five tokens from the TV News Archive were coded for whether speakers produced a gesture with the word, and whether the gesture was iconic. The results show that high iconicity words have a higher overall gesture rate (69%) than low iconicity words (56%): specifically, high iconicity words have a higher <i>iconic</i> gesture rate (24% vs. 11%). This effect is more pronounced among verbs than adjectives, which we hypothesize may be due to the dynamic nature of verbs. We also find that this result persists when controlling for perceptual and action strength ratings, suggesting that word-level iconicity is a more important predictor than sensorimotor strength of whether a speaker will use an iconic gesture. We find that some high iconicity words are more likely to occur with iconic gestures when they come with markers of syntactic isolation, suggesting that morphosyntactic behavior is also relevant to iconic gesture production. Our findings demonstrate that iconicity in spoken communication is inherently multimodal, manifesting in both speech and gesture simultaneously, and that iconicity is often psychologically active when speakers use conventionalized iconic words.</p>\",\"PeriodicalId\":48349,\"journal\":{\"name\":\"Cognitive Science\",\"volume\":\"49 8\",\"pages\":\"\"},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2025-08-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1111/cogs.70098\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cognitive Science\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/cogs.70098\",\"RegionNum\":2,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PSYCHOLOGY, EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cognitive Science","FirstCategoryId":"102","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/cogs.70098","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
Iconicity ratings studies have established that there are many English words which native speakers judge as “iconic,” that is, as sounding like what they mean. Here, we explore whether these iconic English words are more likely to be accompanied by iconic gestures. We report a large-scale quantitative study comparing the gesture rate of words rated as high in iconicity (e.g., swoosh, puffy, crispy) to those rated as low in iconicity (e.g., ordain, rejoin, grateful), balancing for perceptual strength, part-of-speech, and syllable length. Five thousand seven hundred and twenty-five tokens from the TV News Archive were coded for whether speakers produced a gesture with the word, and whether the gesture was iconic. The results show that high iconicity words have a higher overall gesture rate (69%) than low iconicity words (56%): specifically, high iconicity words have a higher iconic gesture rate (24% vs. 11%). This effect is more pronounced among verbs than adjectives, which we hypothesize may be due to the dynamic nature of verbs. We also find that this result persists when controlling for perceptual and action strength ratings, suggesting that word-level iconicity is a more important predictor than sensorimotor strength of whether a speaker will use an iconic gesture. We find that some high iconicity words are more likely to occur with iconic gestures when they come with markers of syntactic isolation, suggesting that morphosyntactic behavior is also relevant to iconic gesture production. Our findings demonstrate that iconicity in spoken communication is inherently multimodal, manifesting in both speech and gesture simultaneously, and that iconicity is often psychologically active when speakers use conventionalized iconic words.
期刊介绍:
Cognitive Science publishes articles in all areas of cognitive science, covering such topics as knowledge representation, inference, memory processes, learning, problem solving, planning, perception, natural language understanding, connectionism, brain theory, motor control, intentional systems, and other areas of interdisciplinary concern. Highest priority is given to research reports that are specifically written for a multidisciplinary audience. The audience is primarily researchers in cognitive science and its associated fields, including anthropologists, education researchers, psychologists, philosophers, linguists, computer scientists, neuroscientists, and roboticists.