同构的可视化--色彩和音乐的共鸣

IF 3.8 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS
Xue Mao, Jie Xu, Jiahong Lang, Shangshu Zhang
{"title":"同构的可视化--色彩和音乐的共鸣","authors":"Xue Mao,&nbsp;Jie Xu,&nbsp;Jiahong Lang,&nbsp;Shangshu Zhang","doi":"10.1016/j.visinf.2023.10.006","DOIUrl":null,"url":null,"abstract":"<div><p>Music and colour, as human hearing and visual art, are closely related to human psychological feelings and symbolic associations. There is an isomorphic relationship between music and colour. The article uses the concept of “synesthesia” in psychology and the “co-construction” relationship in mathematics as a bridge, based on Kandinsky’s “inner sound” theory and Mallion’s “tone-colour system”, an interdisciplinary theoretical model of “timbre isomorphism synesthesia” (ISCM) is constructed. At the practical level, based on the ISCM theory, a set of timbre synesthesia visualization tools ASAH and visualization processes are designed, through music data input, graphics mapping visualization, colour mapping visualization, real-time interactive visualization, and finally output timbre synesthesia visualization works. In order to avoid the visual homogenization caused by algorithm design, ASHA has set up a custom editor, which emphasizes the individual differences and multi-sensory experience of tonal synesthesia visualization.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 110-114"},"PeriodicalIF":3.8000,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000517/pdfft?md5=680eca924eb901cc315deae17009a9ef&pid=1-s2.0-S2468502X23000517-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Visualization of isomorphism-synesthesia of colour and music\",\"authors\":\"Xue Mao,&nbsp;Jie Xu,&nbsp;Jiahong Lang,&nbsp;Shangshu Zhang\",\"doi\":\"10.1016/j.visinf.2023.10.006\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Music and colour, as human hearing and visual art, are closely related to human psychological feelings and symbolic associations. There is an isomorphic relationship between music and colour. The article uses the concept of “synesthesia” in psychology and the “co-construction” relationship in mathematics as a bridge, based on Kandinsky’s “inner sound” theory and Mallion’s “tone-colour system”, an interdisciplinary theoretical model of “timbre isomorphism synesthesia” (ISCM) is constructed. At the practical level, based on the ISCM theory, a set of timbre synesthesia visualization tools ASAH and visualization processes are designed, through music data input, graphics mapping visualization, colour mapping visualization, real-time interactive visualization, and finally output timbre synesthesia visualization works. In order to avoid the visual homogenization caused by algorithm design, ASHA has set up a custom editor, which emphasizes the individual differences and multi-sensory experience of tonal synesthesia visualization.</p></div>\",\"PeriodicalId\":36903,\"journal\":{\"name\":\"Visual Informatics\",\"volume\":\"7 4\",\"pages\":\"Pages 110-114\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2023-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2468502X23000517/pdfft?md5=680eca924eb901cc315deae17009a9ef&pid=1-s2.0-S2468502X23000517-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Visual Informatics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2468502X23000517\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Visual Informatics","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2468502X23000517","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

音乐和色彩作为人的听觉和视觉艺术,与人的心理感受和符号联想密切相关。音乐和色彩之间有一种同构关系。本文以心理学中的“联觉”概念和数学中的“共构”关系为桥梁,以康定斯基的“内在声音”理论和马列恩的“音色系统”为基础,构建了一个跨学科的“音色同构联觉”理论模型。在实践层面,基于ISCM理论,设计了一套音色联觉可视化工具ASAH和可视化流程,通过音乐数据输入、图形映射可视化、色彩映射可视化、实时交互可视化,最终输出音色联觉可视化作品。为了避免算法设计造成的视觉同质化,ASHA设置了自定义编辑器,强调了调性联觉可视化的个体差异和多感官体验。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Visualization of isomorphism-synesthesia of colour and music

Music and colour, as human hearing and visual art, are closely related to human psychological feelings and symbolic associations. There is an isomorphic relationship between music and colour. The article uses the concept of “synesthesia” in psychology and the “co-construction” relationship in mathematics as a bridge, based on Kandinsky’s “inner sound” theory and Mallion’s “tone-colour system”, an interdisciplinary theoretical model of “timbre isomorphism synesthesia” (ISCM) is constructed. At the practical level, based on the ISCM theory, a set of timbre synesthesia visualization tools ASAH and visualization processes are designed, through music data input, graphics mapping visualization, colour mapping visualization, real-time interactive visualization, and finally output timbre synesthesia visualization works. In order to avoid the visual homogenization caused by algorithm design, ASHA has set up a custom editor, which emphasizes the individual differences and multi-sensory experience of tonal synesthesia visualization.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Visual Informatics
Visual Informatics Computer Science-Computer Graphics and Computer-Aided Design
CiteScore
6.70
自引率
3.30%
发文量
33
审稿时长
79 days
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信