Journal on Multimodal User Interfaces最新文献_第7页

A wearable virtual touch system for IVIS in cars 一种用于车载IVIS的可穿戴式虚拟触摸系统

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-06-22 DOI: 10.1007/s12193-021-00377-9

Gowdham Prabhakar, Priyam Rajkhowa, Dharmesh Harsha, Pradipta Biswas

{"title":"A wearable virtual touch system for IVIS in cars","authors":"Gowdham Prabhakar, Priyam Rajkhowa, Dharmesh Harsha, Pradipta Biswas","doi":"10.1007/s12193-021-00377-9","DOIUrl":"https://doi.org/10.1007/s12193-021-00377-9","url":null,"abstract":"In automotive domain, operation of secondary tasks like accessing infotainment system, adjusting air conditioning vents, and side mirrors distract drivers from driving. Though existing modalities like gesture and speech recognition systems facilitate undertaking secondary tasks by reducing duration of eyes off the road, those often require remembering a set of gestures or screen sequences. In this paper, we have proposed two different modalities for drivers to virtually touch the dashboard display using a laser tracker with a mechanical switch and an eye gaze switch. We compared performances of our proposed modalities against conventional touch modality in automotive environment by comparing pointing and selection times of representative secondary task and also analysed effect on driving performance in terms of deviation from lane, average speed, variation in perceived workload and system usability. We did not find significant difference in driving and pointing performance between laser tracking system and existing touchscreen system. Our result also showed that the driving and pointing performance of the virtual touch system with eye gaze switch was significantly better than the same with mechanical switch. We evaluated the efficacy of the proposed virtual touch system with eye gaze switch inside a real car and investigated acceptance of the system by professional drivers using qualitative research. The quantitative and qualitative studies indicated importance of using multimodal system inside car and highlighted several criteria for acceptance of new automotive user interface.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"46 3","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508813","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Interactive exploration of a hierarchical spider web structure with sound 一个层次蜘蛛网结构与声音的互动探索

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-06-21 DOI: 10.1007/s12193-021-00375-x

Isabelle Su, Ian Hattwick, Christine Southworth, Evan Ziporyn, Ally Bisshop, R. Mühlethaler, Tomás Saraceno, M. Buehler

引用次数: 5

Correction to: A gaze-based interactive system to explore artwork imagery 更正:一个基于凝视的互动系统，用于探索艺术品图像

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-05-31 DOI: 10.1007/s12193-021-00374-y

Piercarlo Dondi, Marco Porta, Angelo Donvito, Giovanni Volpe

引用次数: 0

A gaze-based interactive system to explore artwork imagery 一个基于凝视的交互式系统，用于探索艺术品图像

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-05-21 DOI: 10.1007/s12193-021-00373-z

Piercarlo Dondi, Marco Porta, Angelo Donvito, Giovanni Volpe

引用次数: 9

Grounding behaviours with conversational interfaces: effects of embodiment and failures 会话接口的接地行为:体现和失败的影响

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-24 DOI: 10.1007/s12193-021-00366-y

Dimosthenis Kontogiorgos, Andre Pereira, Joakim Gustafson

{"title":"Grounding behaviours with conversational interfaces: effects of embodiment and failures","authors":"Dimosthenis Kontogiorgos, Andre Pereira, Joakim Gustafson","doi":"10.1007/s12193-021-00366-y","DOIUrl":"https://doi.org/10.1007/s12193-021-00366-y","url":null,"abstract":"Conversational interfaces that interact with humans need to continuously establish, maintain and repair common ground in task-oriented dialogues. Uncertainty, repairs and acknowledgements are expressed in user behaviour in the continuous efforts of the conversational partners to maintain mutual understanding. Users change their behaviour when interacting with systems in different forms of embodiment, which affects the abilities of these interfaces to observe users’ recurrent social signals. Additionally, humans are intellectually biased towards social activity when facing anthropomorphic agents or when presented with subtle social cues. Two studies are presented in this paper examining how humans interact in a referential communication task with wizarded interfaces in different forms of embodiment. In study 1 (N = 30), we test whether humans respond the same way to agents, in different forms of embodiment and social behaviour. In study 2 (N = 44), we replicate the same task and agents but introduce conversational failures disrupting the process of grounding. Findings indicate that it is not always favourable for agents to be anthropomorphised or to communicate with non-verbal cues, as human grounding behaviours change when embodiment and failures are manipulated.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"32 3","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

RFID-based tangible and touch tabletop for dual reality in crisis management context 危机管理环境中基于射频识别的有形和触摸桌面双重现实

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-19 DOI: 10.1007/s12193-021-00370-2

Walid Merrad, A. Héloir, C. Kolski, Antonio Krüger

引用次数: 7

Behavior and usability analysis for multimodal user interfaces 多模态用户界面的行为和可用性分析

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-16 DOI: 10.1007/s12193-021-00372-0

Hamdi Dibeklioğlu, Elif Surer, A. A. Salah, T. Dutoit

引用次数: 2

Identifying and evaluating conceptual representations for auditory-enhanced interactive physics simulations 识别和评估听觉增强的交互式物理模拟的概念表示

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-15 DOI: 10.1007/s12193-021-00365-z

Brianna J. Tomlinson, B. Walker, Emily B. Moore

引用次数: 2

Non-native speaker perception of Intelligent Virtual Agents in two languages: the impact of amount and type of grammatical mistakes 非母语人士对两种语言智能虚拟代理的感知:语法错误数量和类型的影响

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-07 DOI: 10.1007/s12193-021-00369-9

David Obremski, Jean-Luc Lugrin, Philipp Schaper, Birgit Lugrin

引用次数: 10

Training public speaking with virtual social interactions: effectiveness of real-time feedback and delayed feedback 用虚拟社会互动训练公开演讲:实时反馈和延迟反馈的有效性

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-06 DOI: 10.1007/s12193-021-00371-1

Mathieu Chollet, Stacy Marsella, Stefan Scherer

{"title":"Training public speaking with virtual social interactions: effectiveness of real-time feedback and delayed feedback","authors":"Mathieu Chollet, Stacy Marsella, Stefan Scherer","doi":"10.1007/s12193-021-00371-1","DOIUrl":"https://doi.org/10.1007/s12193-021-00371-1","url":null,"abstract":"Social signal processing and virtual social interaction technologies have allowed the creation of social skills training applications, and initial studies have shown that such solutions can lead to positive training outcomes and could complement traditional teaching methods by providing cheap, accessible, safe tools for training social skills. However, these studies evaluated social skills training systems as a whole and it is unclear to what extent which components contributed to positive outcomes. In this paper, we describe an experimental study where we compared the relative efficacy of real-time interactive feedback and after-action feedback in the context of a public speaking training application. We observed that both components provide benefits to the overall training: the real-time interactive feedback made the experience more immersive and improved participants’ motivation in using the system, while the after-action feedback led to positive training outcomes when it contained personalized feedback elements. Taken in combination, these results confirm that both social signal processing technologies and virtual social interactions are both contributing to social skills training systems’ efficiency. Additionally, we observed that several individual factors, here the subjects’ initial level of public speaking anxiety, personality and tendency to immersion significantly influenced the training experience. This finding suggests that social skills training systems could benefit from being tailored to participants’ particular individual circumstances.\u0000","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"31 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7