颜色-触觉跨模态对应及其对多模态感知中单模态判断的影响

IF 1.8 4区 心理学 Q3 BIOPHYSICS
Tianyi Yuan, P. Rau, Jingyu Zhao, Jian Zheng
{"title":"颜色-触觉跨模态对应及其对多模态感知中单模态判断的影响","authors":"Tianyi Yuan, P. Rau, Jingyu Zhao, Jian Zheng","doi":"10.1163/22134808-bja10098","DOIUrl":null,"url":null,"abstract":"\nThis study explored the colour–touch cross-modal correspondence and its impact on colour–touch multisensory perception. Two laboratory experiments were conducted based on a pre-experiment. In the first experiment, participants chose the colour according to their tactile sense against the vibration generated by the smartphone simulator. A positive cross-modal correspondence was obtained between the vibration amplitude and the colour chroma, indicating the existence of a colour–touch correspondence. The correspondence between vibration parameters and colour hue was preliminarily explored. The impact of the correspondence on the multisensory senses was investigated in the second experiment. Different stimulus combinations were played on a smartphone. The participants were asked to choose the perceived stimulus level. The data illustrated that a better correspondence improved judgement accuracy and reduced reactiontime. Overall, this study offers evidence for colour–touch cross-modal correspondence and presents its potential influence on the single-modal judgement in multimodal perception. The results can be applied in further cross-modal studies, assisting barrier-free society construction and multimodal interface design.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":null,"pages":null},"PeriodicalIF":1.8000,"publicationDate":"2023-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Colour–Touch Cross-Modal Correspondence and Its Impact on Single-Modal Judgement in Multimodal Perception\",\"authors\":\"Tianyi Yuan, P. Rau, Jingyu Zhao, Jian Zheng\",\"doi\":\"10.1163/22134808-bja10098\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\nThis study explored the colour–touch cross-modal correspondence and its impact on colour–touch multisensory perception. Two laboratory experiments were conducted based on a pre-experiment. In the first experiment, participants chose the colour according to their tactile sense against the vibration generated by the smartphone simulator. A positive cross-modal correspondence was obtained between the vibration amplitude and the colour chroma, indicating the existence of a colour–touch correspondence. The correspondence between vibration parameters and colour hue was preliminarily explored. The impact of the correspondence on the multisensory senses was investigated in the second experiment. Different stimulus combinations were played on a smartphone. The participants were asked to choose the perceived stimulus level. The data illustrated that a better correspondence improved judgement accuracy and reduced reactiontime. Overall, this study offers evidence for colour–touch cross-modal correspondence and presents its potential influence on the single-modal judgement in multimodal perception. The results can be applied in further cross-modal studies, assisting barrier-free society construction and multimodal interface design.\",\"PeriodicalId\":51298,\"journal\":{\"name\":\"Multisensory Research\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2023-05-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Multisensory Research\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1163/22134808-bja10098\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"BIOPHYSICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Multisensory Research","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1163/22134808-bja10098","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"BIOPHYSICS","Score":null,"Total":0}
引用次数: 0

摘要

本研究探讨了色-触觉的跨模态对应及其对色-触觉多感官知觉的影响。在预实验的基础上进行了两次室内实验。在第一个实验中,参与者根据自己的触觉和智能手机模拟器产生的振动来选择颜色。在振动振幅和色度之间获得了正的跨模态对应关系,表明存在色-触对应关系。初步探讨了振动参数与色相的对应关系。在第二个实验中,研究了对应对多感官的影响。在智能手机上播放不同的刺激组合。参与者被要求选择感知到的刺激水平。数据表明,较好的对应关系提高了判断精度,缩短了反应时间。总的来说,本研究提供了颜色-触觉跨模态对应的证据,并展示了其对多模态感知中单模态判断的潜在影响。研究结果可用于进一步的跨模态研究,为无障碍社会建设和多模态界面设计提供帮助。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Colour–Touch Cross-Modal Correspondence and Its Impact on Single-Modal Judgement in Multimodal Perception
This study explored the colour–touch cross-modal correspondence and its impact on colour–touch multisensory perception. Two laboratory experiments were conducted based on a pre-experiment. In the first experiment, participants chose the colour according to their tactile sense against the vibration generated by the smartphone simulator. A positive cross-modal correspondence was obtained between the vibration amplitude and the colour chroma, indicating the existence of a colour–touch correspondence. The correspondence between vibration parameters and colour hue was preliminarily explored. The impact of the correspondence on the multisensory senses was investigated in the second experiment. Different stimulus combinations were played on a smartphone. The participants were asked to choose the perceived stimulus level. The data illustrated that a better correspondence improved judgement accuracy and reduced reactiontime. Overall, this study offers evidence for colour–touch cross-modal correspondence and presents its potential influence on the single-modal judgement in multimodal perception. The results can be applied in further cross-modal studies, assisting barrier-free society construction and multimodal interface design.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Multisensory Research
Multisensory Research BIOPHYSICS-PSYCHOLOGY
CiteScore
3.50
自引率
12.50%
发文量
15
期刊介绍: Multisensory Research is an interdisciplinary archival journal covering all aspects of multisensory processing including the control of action, cognition and attention. Research using any approach to increase our understanding of multisensory perceptual, behavioural, neural and computational mechanisms is encouraged. Empirical, neurophysiological, psychophysical, brain imaging, clinical, developmental, mathematical and computational analyses are welcome. Research will also be considered covering multisensory applications such as sensory substitution, crossmodal methods for delivering sensory information or multisensory approaches to robotics and engineering. Short communications and technical notes that draw attention to new developments will be included, as will reviews and commentaries on current issues. Special issues dealing with specific topics will be announced from time to time. Multisensory Research is a continuation of Seeing and Perceiving, and of Spatial Vision.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信