视觉上相似的人脸表情符号的语义差异

IF 1.1 3区 心理学 0 LANGUAGE & LINGUISTICS
Lea Fricke, Patrick G. Grosz, Tatjana Scheffler
{"title":"视觉上相似的人脸表情符号的语义差异","authors":"Lea Fricke, Patrick G. Grosz, Tatjana Scheffler","doi":"10.1017/langcog.2024.12","DOIUrl":null,"url":null,"abstract":"<p>The literature on face emojis raises the central question whether they should be treated as pictures or conventionalized signals. Our experiment addresses this question by investigating semantic differences in visually similar face emojis. We test a prediction following from a pictorial approach: small visual features of emojis that do not correspond to human facial features should be semantically less relevant than features that represent aspects of facial expressions. We compare emoji pairs with a visual difference that either does or does not correspond to a difference in a human facial expression according to an adaptation of the Facial Action Coding System. We created two contexts per pair, each fitted to correspond to a prominent meaning of one or the other emoji. Participants had to choose a suitable emoji for each context. The rate at which the context-matching emoji was chosen was significantly above chance for both types of emoji pairs and it did not differ significantly between them. Our results show that the small differences are meaningful in all pairs whether or not they correspond to human facial differences. This supports a lexicalist approach to emoji semantics, which treats face emojis as conventionalized signals rather than mere pictures of faces.</p>","PeriodicalId":45880,"journal":{"name":"Language and Cognition","volume":"158 1","pages":""},"PeriodicalIF":1.1000,"publicationDate":"2024-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Semantic differences in visually similar face emojis\",\"authors\":\"Lea Fricke, Patrick G. Grosz, Tatjana Scheffler\",\"doi\":\"10.1017/langcog.2024.12\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The literature on face emojis raises the central question whether they should be treated as pictures or conventionalized signals. Our experiment addresses this question by investigating semantic differences in visually similar face emojis. We test a prediction following from a pictorial approach: small visual features of emojis that do not correspond to human facial features should be semantically less relevant than features that represent aspects of facial expressions. We compare emoji pairs with a visual difference that either does or does not correspond to a difference in a human facial expression according to an adaptation of the Facial Action Coding System. We created two contexts per pair, each fitted to correspond to a prominent meaning of one or the other emoji. Participants had to choose a suitable emoji for each context. The rate at which the context-matching emoji was chosen was significantly above chance for both types of emoji pairs and it did not differ significantly between them. Our results show that the small differences are meaningful in all pairs whether or not they correspond to human facial differences. This supports a lexicalist approach to emoji semantics, which treats face emojis as conventionalized signals rather than mere pictures of faces.</p>\",\"PeriodicalId\":45880,\"journal\":{\"name\":\"Language and Cognition\",\"volume\":\"158 1\",\"pages\":\"\"},\"PeriodicalIF\":1.1000,\"publicationDate\":\"2024-03-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Language and Cognition\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1017/langcog.2024.12\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"0\",\"JCRName\":\"LANGUAGE & LINGUISTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Language and Cognition","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1017/langcog.2024.12","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"LANGUAGE & LINGUISTICS","Score":null,"Total":0}
引用次数: 0

摘要

有关人脸表情符号的文献提出了一个核心问题,即这些表情符号应被视为图片还是传统化的信号。我们的实验通过研究视觉上相似的表情符号的语义差异来解决这个问题。我们测试了从图像方法得出的一个预测:表情符号中与人类面部特征不对应的小视觉特征在语义上的相关性应低于代表面部表情方面的特征。我们根据面部动作编码系统(Facial Action Coding System)的改编,对视觉差异与人类面部表情差异对应或不对应的表情符号对进行比较。我们为每对表情符号创建了两个情境,每个情境都与一个或另一个表情符号的突出含义相对应。参与者必须为每个情境选择一个合适的表情符号。在两种类型的表情符号配对中,选择与语境相匹配的表情符号的比率都明显高于偶然性,而且两者之间没有明显差异。我们的结果表明,无论是否与人类面部差异相对应,所有配对中的微小差异都是有意义的。这支持了对表情符号语义的词法主义方法,该方法将人脸表情符号视为常规化的信号,而不仅仅是人脸图片。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Semantic differences in visually similar face emojis

The literature on face emojis raises the central question whether they should be treated as pictures or conventionalized signals. Our experiment addresses this question by investigating semantic differences in visually similar face emojis. We test a prediction following from a pictorial approach: small visual features of emojis that do not correspond to human facial features should be semantically less relevant than features that represent aspects of facial expressions. We compare emoji pairs with a visual difference that either does or does not correspond to a difference in a human facial expression according to an adaptation of the Facial Action Coding System. We created two contexts per pair, each fitted to correspond to a prominent meaning of one or the other emoji. Participants had to choose a suitable emoji for each context. The rate at which the context-matching emoji was chosen was significantly above chance for both types of emoji pairs and it did not differ significantly between them. Our results show that the small differences are meaningful in all pairs whether or not they correspond to human facial differences. This supports a lexicalist approach to emoji semantics, which treats face emojis as conventionalized signals rather than mere pictures of faces.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
4.20
自引率
0.00%
发文量
34
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信