Journal on Multimodal User Interfaces最新文献_第7页

Correction to: A gaze-based interactive system to explore artwork imagery 更正:一个基于凝视的互动系统，用于探索艺术品图像

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-05-31 DOI: 10.1007/s12193-021-00374-y

Piercarlo Dondi, Marco Porta, Angelo Donvito, Giovanni Volpe

引用次数: 0

A gaze-based interactive system to explore artwork imagery 一个基于凝视的交互式系统，用于探索艺术品图像

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-05-21 DOI: 10.1007/s12193-021-00373-z

Piercarlo Dondi, Marco Porta, Angelo Donvito, Giovanni Volpe

引用次数: 9

Grounding behaviours with conversational interfaces: effects of embodiment and failures 会话接口的接地行为:体现和失败的影响

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-24 DOI: 10.1007/s12193-021-00366-y

Dimosthenis Kontogiorgos, Andre Pereira, Joakim Gustafson

{"title":"Grounding behaviours with conversational interfaces: effects of embodiment and failures","authors":"Dimosthenis Kontogiorgos, Andre Pereira, Joakim Gustafson","doi":"10.1007/s12193-021-00366-y","DOIUrl":"https://doi.org/10.1007/s12193-021-00366-y","url":null,"abstract":"Conversational interfaces that interact with humans need to continuously establish, maintain and repair common ground in task-oriented dialogues. Uncertainty, repairs and acknowledgements are expressed in user behaviour in the continuous efforts of the conversational partners to maintain mutual understanding. Users change their behaviour when interacting with systems in different forms of embodiment, which affects the abilities of these interfaces to observe users’ recurrent social signals. Additionally, humans are intellectually biased towards social activity when facing anthropomorphic agents or when presented with subtle social cues. Two studies are presented in this paper examining how humans interact in a referential communication task with wizarded interfaces in different forms of embodiment. In study 1 (N = 30), we test whether humans respond the same way to agents, in different forms of embodiment and social behaviour. In study 2 (N = 44), we replicate the same task and agents but introduce conversational failures disrupting the process of grounding. Findings indicate that it is not always favourable for agents to be anthropomorphised or to communicate with non-verbal cues, as human grounding behaviours change when embodiment and failures are manipulated.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"32 3","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

RFID-based tangible and touch tabletop for dual reality in crisis management context 危机管理环境中基于射频识别的有形和触摸桌面双重现实

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-19 DOI: 10.1007/s12193-021-00370-2

Walid Merrad, A. Héloir, C. Kolski, Antonio Krüger

引用次数: 7

Behavior and usability analysis for multimodal user interfaces 多模态用户界面的行为和可用性分析

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-16 DOI: 10.1007/s12193-021-00372-0

Hamdi Dibeklioğlu, Elif Surer, A. A. Salah, T. Dutoit

引用次数: 2

Identifying and evaluating conceptual representations for auditory-enhanced interactive physics simulations 识别和评估听觉增强的交互式物理模拟的概念表示

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-15 DOI: 10.1007/s12193-021-00365-z

Brianna J. Tomlinson, B. Walker, Emily B. Moore

引用次数: 2

Non-native speaker perception of Intelligent Virtual Agents in two languages: the impact of amount and type of grammatical mistakes 非母语人士对两种语言智能虚拟代理的感知:语法错误数量和类型的影响

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-07 DOI: 10.1007/s12193-021-00369-9

David Obremski, Jean-Luc Lugrin, Philipp Schaper, Birgit Lugrin

引用次数: 10

Training public speaking with virtual social interactions: effectiveness of real-time feedback and delayed feedback 用虚拟社会互动训练公开演讲:实时反馈和延迟反馈的有效性

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-06 DOI: 10.1007/s12193-021-00371-1

Mathieu Chollet, Stacy Marsella, Stefan Scherer

{"title":"Training public speaking with virtual social interactions: effectiveness of real-time feedback and delayed feedback","authors":"Mathieu Chollet, Stacy Marsella, Stefan Scherer","doi":"10.1007/s12193-021-00371-1","DOIUrl":"https://doi.org/10.1007/s12193-021-00371-1","url":null,"abstract":"Social signal processing and virtual social interaction technologies have allowed the creation of social skills training applications, and initial studies have shown that such solutions can lead to positive training outcomes and could complement traditional teaching methods by providing cheap, accessible, safe tools for training social skills. However, these studies evaluated social skills training systems as a whole and it is unclear to what extent which components contributed to positive outcomes. In this paper, we describe an experimental study where we compared the relative efficacy of real-time interactive feedback and after-action feedback in the context of a public speaking training application. We observed that both components provide benefits to the overall training: the real-time interactive feedback made the experience more immersive and improved participants’ motivation in using the system, while the after-action feedback led to positive training outcomes when it contained personalized feedback elements. Taken in combination, these results confirm that both social signal processing technologies and virtual social interactions are both contributing to social skills training systems’ efficiency. Additionally, we observed that several individual factors, here the subjects’ initial level of public speaking anxiety, personality and tendency to immersion significantly influenced the training experience. This finding suggests that social skills training systems could benefit from being tailored to participants’ particular individual circumstances.\u0000","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"31 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

An expert-model and machine learning hybrid approach to predicting human-agent negotiation outcomes in varied data 一种专家模型和机器学习混合方法在不同数据中预测人类代理谈判结果

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-03-03 DOI: 10.1007/s12193-021-00368-w

Johnathan Mell, Markus Beissinger, Jonathan Gratch

{"title":"An expert-model and machine learning hybrid approach to predicting human-agent negotiation outcomes in varied data","authors":"Johnathan Mell, Markus Beissinger, Jonathan Gratch","doi":"10.1007/s12193-021-00368-w","DOIUrl":"https://doi.org/10.1007/s12193-021-00368-w","url":null,"abstract":"We present the results of a machine-learning approach to the analysis of several human-agent negotiation studies. By combining expert knowledge of negotiating behavior compiled over a series of empirical studies with neural networks, we show that a hybrid approach to parameter selection yields promise for designing more effective and socially intelligent agents. Specifically, we show that a deep feedforward neural network using a theory-driven three-parameter model can be effective in predicting negotiation outcomes. Furthermore, it outperforms other expert-designed models that use more parameters, as well as those using other techniques (such as linear regression models or boosted decision trees). In a follow-up study, we show that the most successful models change as the dataset size increases and the prediction targets change, and show that boosted decision trees may not be suitable for the negotiation domain. We anticipate these results will have impact for those seeking to combine extensive domain knowledge with more automated approaches in human-computer negotiation. Further, we show that this approach can be a stepping stone from purely exploratory research to targeted human-behavioral experimentation. Through our approach, areas of social artificial intelligence that have historically benefited from expert knowledge and traditional AI approaches can be combined with more recent proven-effective machine learning algorithms.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"34 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2021-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508787","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

MUMBAI: multi-person, multimodal board game affect and interaction analysis dataset 多人、多模式棋盘游戏影响和互动分析数据集

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2021-02-22 DOI: 10.1007/s12193-021-00364-0

Metehan Doyran, Arjan Schimmel, P. Baki, Kübra Ergin, Batikan Türkmen, A. A. Salah, S. Bakkes, Heysem Kaya, R. Poppe, A. A. Salah

引用次数: 19