Journal on Multimodal User Interfaces最新文献_第6页

Preliminary assessment of a multimodal electric-powered wheelchair simulator for training of activities of daily living 用于日常生活活动训练的多模式电动轮椅模拟器的初步评估

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-11-19 DOI: 10.1007/s12193-021-00385-9

F. Martins, E. Naves, Y. Morère, A. D. de Sá

引用次数: 4

Importance of force feedback for following uneven virtual paths with a stylus 使用手写笔跟踪不均匀虚拟路径时力反馈的重要性

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-10-30 DOI: 10.1007/s12193-021-00384-w

F. Fontana, Francesco Muzzolini, D. Rocchesso

引用次数: 0

The effect of eye movement sonification on visual search patterns and anticipation in novices 眼动超声对新手视觉搜索模式和预期的影响

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-10-18 DOI: 10.1007/s12193-021-00381-z

M. Khalaji, M. Aghdaei, A. Farsi, A. Piras

引用次数: 0

Informing the design of a multisensory learning environment for elementary mathematics learning 为小学数学多感官学习环境的设计提供参考

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-10-11 DOI: 10.1007/s12193-021-00382-y

L. Cuturi, G. Cappagli, N. Yiannoutsou, S. Price, M. Gori

引用次数: 10

Advanced multimodal interaction techniques and user interfaces for serious games and virtual environments 用于严肃游戏和虚拟环境的高级多模式交互技术和用户界面

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-08-10 DOI: 10.1007/s12193-021-00380-0

F. Liarokapis, S. Mammen, A. Vourvopoulos

引用次数: 3

TapCalculator: nonvisual touchscreen calculator for visually impaired people preliminary user study TapCalculator:为视障人士设计的非视觉触摸屏计算器

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-08-09 DOI: 10.1007/s12193-021-00379-7

Mrim M. Alnfiai

引用次数: 1

Combining audio and visual displays to highlight temporal and spatial seismic patterns 结合声音和视觉显示，突出时间和空间的地震模式

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-07-27 DOI: 10.1007/s12193-021-00378-8

Arthur Paté, Gaspard Farge, Benjamin K. Holtzman, Anna C. Barth, Piero Poli, Lapo Boschi, Leif Karlstrom

{"title":"Combining audio and visual displays to highlight temporal and spatial seismic patterns","authors":"Arthur Paté, Gaspard Farge, Benjamin K. Holtzman, Anna C. Barth, Piero Poli, Lapo Boschi, Leif Karlstrom","doi":"10.1007/s12193-021-00378-8","DOIUrl":"https://doi.org/10.1007/s12193-021-00378-8","url":null,"abstract":"<p>Data visualization, and to a lesser extent data sonification, are classic tools to the scientific community. However, these two approaches are very rarely combined, although they are highly complementary: our visual system is good at recognizing spatial patterns, whereas our auditory system is better tuned for temporal patterns. In this article, data representation methods are proposed that combine visualization, sonification, and spatial audio techniques, in order to optimize the user’s perception of spatial and temporal patterns in a single display, to increase the feeling of immersion, and to take advantage of multimodal integration mechanisms. Three seismic data sets are used to illustrate the methods, covering different physical phenomena, time scales, spatial distributions, and spatio-temporal dynamics. The methods are adapted to the specificities of each data set, and to the amount of information that the designer wants to display. This leads to further developments, namely the use of audification with two time scales, the switch from pure audification to time-modulated noise, and the switch from pure audification to sonic icons. First user feedback from live demonstrations indicates that the methods presented in this article seem to enhance the perception of spatio-temporal patterns, which is a key parameter to the understanding of seismically active systems, and a step towards apprehending the processes that drive this activity.\u0000</p>","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"45 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

SoundSight: a mobile sensory substitution device that sonifies colour, distance, and temperature SoundSight：一种可对颜色、距离和温度进行超声波处理的移动感官替代设备

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-07-02 DOI: 10.1007/s12193-021-00376-w

Giles Hamilton-Fletcher, James Alvarez, Marianna Obrist, Jamie Ward

引用次数: 10

A wearable virtual touch system for IVIS in cars 一种用于车载IVIS的可穿戴式虚拟触摸系统

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-06-22 DOI: 10.1007/s12193-021-00377-9

Gowdham Prabhakar, Priyam Rajkhowa, Dharmesh Harsha, Pradipta Biswas

{"title":"A wearable virtual touch system for IVIS in cars","authors":"Gowdham Prabhakar, Priyam Rajkhowa, Dharmesh Harsha, Pradipta Biswas","doi":"10.1007/s12193-021-00377-9","DOIUrl":"https://doi.org/10.1007/s12193-021-00377-9","url":null,"abstract":"<p>In automotive domain, operation of secondary tasks like accessing infotainment system, adjusting air conditioning vents, and side mirrors distract drivers from driving. Though existing modalities like gesture and speech recognition systems facilitate undertaking secondary tasks by reducing duration of eyes off the road, those often require remembering a set of gestures or screen sequences. In this paper, we have proposed two different modalities for drivers to virtually touch the dashboard display using a laser tracker with a mechanical switch and an eye gaze switch. We compared performances of our proposed modalities against conventional touch modality in automotive environment by comparing pointing and selection times of representative secondary task and also analysed effect on driving performance in terms of deviation from lane, average speed, variation in perceived workload and system usability. We did not find significant difference in driving and pointing performance between laser tracking system and existing touchscreen system. Our result also showed that the driving and pointing performance of the virtual touch system with eye gaze switch was significantly better than the same with mechanical switch. We evaluated the efficacy of the proposed virtual touch system with eye gaze switch inside a real car and investigated acceptance of the system by professional drivers using qualitative research. The quantitative and qualitative studies indicated importance of using multimodal system inside car and highlighted several criteria for acceptance of new automotive user interface.</p>","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"46 3","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508813","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Interactive exploration of a hierarchical spider web structure with sound 一个层次蜘蛛网结构与声音的互动探索

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-06-21 DOI: 10.1007/s12193-021-00375-x

Isabelle Su, Ian Hattwick, Christine Southworth, Evan Ziporyn, Ally Bisshop, R. Mühlethaler, Tomás Saraceno, M. Buehler

引用次数: 5