Journal on Multimodal User Interfaces最新文献_第6页

Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot 结合触觉和惯性动作捕捉增强双臂机器人的远程控制

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2022-01-09 DOI: 10.1007/s12193-021-00386-8

Vicent Girbés-Juan, Vinicius Schettino, Luis Gracia, J. Ernesto Solanes, Yiannis Demiris, Josep Tornero

{"title":"Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot","authors":"Vicent Girbés-Juan, Vinicius Schettino, Luis Gracia, J. Ernesto Solanes, Yiannis Demiris, Josep Tornero","doi":"10.1007/s12193-021-00386-8","DOIUrl":"https://doi.org/10.1007/s12193-021-00386-8","url":null,"abstract":"High dexterity is required in tasks in which there is contact between objects, such as surface conditioning (wiping, polishing, scuffing, sanding, etc.), specially when the location of the objects involved is unknown or highly inaccurate because they are moving, like a car body in automotive industry lines. These applications require the human adaptability and the robot accuracy. However, sharing the same workspace is not possible in most cases due to safety issues. Hence, a multi-modal teleoperation system combining haptics and an inertial motion capture system is introduced in this work. The human operator gets the sense of touch thanks to haptic feedback, whereas using the motion capture device allows more naturalistic movements. Visual feedback assistance is also introduced to enhance immersion. A Baxter dual-arm robot is used to offer more flexibility and manoeuvrability, allowing to perform two independent operations simultaneously. Several tests have been carried out to assess the proposed system. As it is shown by the experimental results, the task duration is reduced and the overall performance improves thanks to the proposed teleoperation method.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"30 2-3","pages":""},"PeriodicalIF":2.9,"publicationDate":"2022-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

The Audio-Corsi: an acoustic virtual reality-based technological solution for evaluating audio-spatial memory abilities 音频- corsi:一种基于声学虚拟现实的技术解决方案，用于评估音频空间记忆能力

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-11-24 DOI: 10.1007/s12193-021-00383-x

Walter Setti, Isaac Alonso-Martinez Engel, Luigi F. Cuturi, Monica Gori, Lorenzo Picinali

{"title":"The Audio-Corsi: an acoustic virtual reality-based technological solution for evaluating audio-spatial memory abilities","authors":"Walter Setti, Isaac Alonso-Martinez Engel, Luigi F. Cuturi, Monica Gori, Lorenzo Picinali","doi":"10.1007/s12193-021-00383-x","DOIUrl":"https://doi.org/10.1007/s12193-021-00383-x","url":null,"abstract":"Spatial memory is a cognitive skill that allows the recall of information about the space, its layout, and items’ locations. We present a novel application built around 3D spatial audio technology to evaluate audio-spatial memory abilities. The sound sources have been spatially distributed employing the 3D Tune-In Toolkit, a virtual acoustic simulator. The participants are presented with sequences of sounds of increasing length emitted from virtual auditory sources around their heads. To identify stimuli positions and register the test responses, we designed a custom-made interface with buttons arranged according to sound locations. We took inspiration from the Corsi-Block test for the experimental procedure, a validated clinical approach for assessing visuo-spatial memory abilities. In two different experimental sessions, the participants were tested with the classical Corsi-Block and, blindfolded, with the proposed task, named Audio-Corsi for brevity. Our results show comparable performance across the two tests in terms of the estimated memory parameter precision. Furthermore, in the Audio-Corsi we observe a lower span compared to the Corsi-Block test. We discuss these results in the context of the theoretical relationship between the auditory and visual sensory modalities and potential applications of this system in multiple scientific and clinical contexts.\u0000","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"36 3","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508819","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Preliminary assessment of a multimodal electric-powered wheelchair simulator for training of activities of daily living 用于日常生活活动训练的多模式电动轮椅模拟器的初步评估

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-11-19 DOI: 10.1007/s12193-021-00385-9

F. Martins, E. Naves, Y. Morère, A. D. de Sá

引用次数: 4

Importance of force feedback for following uneven virtual paths with a stylus 使用手写笔跟踪不均匀虚拟路径时力反馈的重要性

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-10-30 DOI: 10.1007/s12193-021-00384-w

F. Fontana, Francesco Muzzolini, D. Rocchesso

引用次数: 0

The effect of eye movement sonification on visual search patterns and anticipation in novices 眼动超声对新手视觉搜索模式和预期的影响

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-10-18 DOI: 10.1007/s12193-021-00381-z

M. Khalaji, M. Aghdaei, A. Farsi, A. Piras

引用次数: 0

Informing the design of a multisensory learning environment for elementary mathematics learning 为小学数学多感官学习环境的设计提供参考

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-10-11 DOI: 10.1007/s12193-021-00382-y

L. Cuturi, G. Cappagli, N. Yiannoutsou, S. Price, M. Gori

引用次数: 10

Advanced multimodal interaction techniques and user interfaces for serious games and virtual environments 用于严肃游戏和虚拟环境的高级多模式交互技术和用户界面

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-08-10 DOI: 10.1007/s12193-021-00380-0

F. Liarokapis, S. Mammen, A. Vourvopoulos

引用次数: 3

TapCalculator: nonvisual touchscreen calculator for visually impaired people preliminary user study TapCalculator:为视障人士设计的非视觉触摸屏计算器

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-08-09 DOI: 10.1007/s12193-021-00379-7

Mrim M. Alnfiai

引用次数: 1

Combining audio and visual displays to highlight temporal and spatial seismic patterns 结合声音和视觉显示，突出时间和空间的地震模式

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-07-27 DOI: 10.1007/s12193-021-00378-8

Arthur Paté, Gaspard Farge, Benjamin K. Holtzman, Anna C. Barth, Piero Poli, Lapo Boschi, Leif Karlstrom

{"title":"Combining audio and visual displays to highlight temporal and spatial seismic patterns","authors":"Arthur Paté, Gaspard Farge, Benjamin K. Holtzman, Anna C. Barth, Piero Poli, Lapo Boschi, Leif Karlstrom","doi":"10.1007/s12193-021-00378-8","DOIUrl":"https://doi.org/10.1007/s12193-021-00378-8","url":null,"abstract":"Data visualization, and to a lesser extent data sonification, are classic tools to the scientific community. However, these two approaches are very rarely combined, although they are highly complementary: our visual system is good at recognizing spatial patterns, whereas our auditory system is better tuned for temporal patterns. In this article, data representation methods are proposed that combine visualization, sonification, and spatial audio techniques, in order to optimize the user’s perception of spatial and temporal patterns in a single display, to increase the feeling of immersion, and to take advantage of multimodal integration mechanisms. Three seismic data sets are used to illustrate the methods, covering different physical phenomena, time scales, spatial distributions, and spatio-temporal dynamics. The methods are adapted to the specificities of each data set, and to the amount of information that the designer wants to display. This leads to further developments, namely the use of audification with two time scales, the switch from pure audification to time-modulated noise, and the switch from pure audification to sonic icons. First user feedback from live demonstrations indicates that the methods presented in this article seem to enhance the perception of spatio-temporal patterns, which is a key parameter to the understanding of seismically active systems, and a step towards apprehending the processes that drive this activity.\u0000","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"45 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

SoundSight: a mobile sensory substitution device that sonifies colour, distance, and temperature SoundSight：一种可对颜色、距离和温度进行超声波处理的移动感官替代设备

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-07-02 DOI: 10.1007/s12193-021-00376-w

Giles Hamilton-Fletcher, James Alvarez, Marianna Obrist, Jamie Ward

引用次数: 10