Journal on Multimodal User Interfaces最新文献_第2页

Introduction to the special issue on design and perception of interactive sonification 介绍互动式声效的设计与感知专题

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-11-02 DOI: 10.1007/s12193-023-00425-6

Tim Ziemer, Sara Lenzi, Niklas Rönnberg, Thomas Hermann, Roberto Bresin

引用次数: 0

Correction to: PepperOSC: enabling interactive sonification of a robot’s expressive movement 更正:PepperOSC:使机器人的表达运动的交互式声音

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-30 DOI: 10.1007/s12193-023-00424-7

Adrian B. Latupeirissa, Roberto Bresin

引用次数: 0

Three-dimensional sonification as a surgical guidance tool 三维超声作为手术指导工具

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-27 DOI: 10.1007/s12193-023-00422-9

Ziemer, Tim

引用次数: 1

A study on the attention of people with low vision to accessibility guidance signs 弱视人群对无障碍引导标志注意的研究

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-26 DOI: 10.1007/s12193-023-00417-6

Weitao Jiang, Bingxin Zhang, Ruiqi Sun, Dong Zhang, Shan Hu

引用次数: 0

An interdisciplinary journey towards an aesthetics of sonification experience 一个跨学科的旅程走向美学的声音体验

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-21 DOI: 10.1007/s12193-023-00416-7

Mariana Seiça, Licínio Roque, Pedro Martins, F. Amílcar Cardoso

{"title":"An interdisciplinary journey towards an aesthetics of sonification experience","authors":"Mariana Seiça, Licínio Roque, Pedro Martins, F. Amílcar Cardoso","doi":"10.1007/s12193-023-00416-7","DOIUrl":"https://doi.org/10.1007/s12193-023-00416-7","url":null,"abstract":"Abstract The aesthetic dimension has been proposed as a potential expansion of sonification design, creating listening pieces that reach the goal of effective data communication. However, current views of aesthetics still aim at optimising mapping criteria to convey the ‘right meaning’, maintaining a mostly functional view on what is considered a successful sonification. This paper proposes an interdisciplinary approach to the aesthetics of sonification experience, grounded on theoretical foundations from phenomenology of interaction, post-phenomenology, cross-cultural studies, acoustic ecology and deep listening. From this journey, we present the following design insights: (1) the design of sonifications becomes a design for experience, (2) co-designed during the interaction with each participant; (3) the sonification artefact gains a mediating role that guides the participant’s intentions in the sonification space; (4) the aesthetics of a sonification experience generates a multistable phenomenon, offering new opportunities to experience multiple perspectives over data; (5) the interaction between human participants and the sonic emanations compose a dialogic space. A call for action to reframe the sonification field into novel design spaces is now open, with aesthetics gaining a transformational role in sonification design and interaction.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135463803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Comparing alternative modalities in the context of multimodal human–robot interaction 在多模态人机交互的背景下比较不同的模态

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-19 DOI: 10.1007/s12193-023-00421-w

Suprakas Saren, Abhishek Mukhopadhyay, Debasish Ghose, Pradipta Biswas

引用次数: 0

Multimodal exploration in elementary music classroom 小学音乐课堂的多模态探索

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-18 DOI: 10.1007/s12193-023-00420-x

Martha Papadogianni, Ercan Altinsoy, Areti Andreopoulou

引用次数: 0

Hearing loss prevention at loud music events via real-time visuo-haptic feedback 通过实时视觉触觉反馈预防大声音乐活动中的听力损失

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-13 DOI: 10.1007/s12193-023-00419-4

Luca Turchet, Simone Luiten, Tjebbe Treub, Marloes van der Burgt, Costanza Siani, Alberto Boem

{"title":"Hearing loss prevention at loud music events via real-time visuo-haptic feedback","authors":"Luca Turchet, Simone Luiten, Tjebbe Treub, Marloes van der Burgt, Costanza Siani, Alberto Boem","doi":"10.1007/s12193-023-00419-4","DOIUrl":"https://doi.org/10.1007/s12193-023-00419-4","url":null,"abstract":"Abstract Hearing loss is becoming a global problem, partly as a consequence of exposure to loud music. People may be unaware about the harmful sound levels and consequent damages caused by loud music at venues such as discotheques or festivals. Earplugs are effective in reducing the risk of noise-induced hearing loss but have been shown to be an insufficient prevention strategy. Thus, when it is not possible to lower the volume of the sound source, a viable solution to the problem is to relocate to quieter locations from time to time. In this context, this study introduces a bracelet device with the goal of warning users when the music sound level is too loud in their specific location, via haptic, visual or visuo-haptic feedback. The bracelet embeds a microphone, a microcontroller, an LED strip and four vibration motors. We performed a user study where thirteen participants were asked to react to the three kinds of feedback during a simulated disco club event where the volume of music pieces varied to reach a loud intensity. Results showed that participants never missed the above threshold notification via all types of feedback, but visual feedback led to the slowest reaction times and was deemed the least effective. In line with the findings reported in the hearing loss prevention literature, the perceived usefulness of the proposed device was highly dependent on participants’ subjective approach to the topic of hearing risks at loud music events as well as their willingness to take action regarding its prevention. Ultimately, our study shows how technology, no matter how effective, may not be able to cope with these kinds of cultural issues concerning hearing loss prevention. Educational strategies may represent a more effective solution to the real problem of changing people’s attitudes and motivations to want to protect their hearing.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135855412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A social robot as your reading companion: exploring the relationships between gaze patterns and knowledge gains 作为你阅读伙伴的社交机器人:探索凝视模式和知识收获之间的关系

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-12 DOI: 10.1007/s12193-023-00418-5

Xuan Liu, Jiachen Ma, Qiang Wang

引用次数: 0

In-vehicle air gesture design: impacts of display modality and control orientation 车载手势设计:显示方式与控制方向的影响

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-09-14 DOI: 10.1007/s12193-023-00415-8

Jason Sterkenburg, Steven Landry, Shabnam FakhrHosseini, Myounghoon Jeon

引用次数: 1