Multimodal Technologies and Interaction最新文献_第6页

Conveying Emotions by Touch to the Nao Robot: A User Experience Perspective 通过触摸向Nao机器人传达情感:用户体验视角

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-12-16 DOI: 10.3390/MTI2040082

Beatrice Alenljung, Rebecca Andreasson, Robert J. Lowe, E. Billing, J. Lindblom

引用次数: 15

Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition Networks 基于并发增强转换网络的自然多模态接口语义融合

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-12-06 DOI: 10.3390/MTI2040081

C. Zimmerer, Martin Fischbach, Marc Erich Latoschik

{"title":"Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition Networks","authors":"C. Zimmerer, Martin Fischbach, Marc Erich Latoschik","doi":"10.3390/MTI2040081","DOIUrl":"https://doi.org/10.3390/MTI2040081","url":null,"abstract":"Semantic fusion is a central requirement of many multimodal interfaces. Procedural methods like finite-state transducers and augmented transition networks have proven to be beneficial to implement semantic fusion. They are compliant with rapid development cycles that are common for the development of user interfaces, in contrast to machine-learning approaches that require time-costly training and optimization. We identify seven fundamental requirements for the implementation of semantic fusion: Action derivation, continuous feedback, context-sensitivity, temporal relation support, access to the interaction context, as well as the support of chronologically unsorted and probabilistic input. A subsequent analysis reveals, however, that there is currently no solution for fulfilling the latter two requirements. As the main contribution of this article, we thus present the Concurrent Cursor concept to compensate these shortcomings. In addition, we showcase a reference implementation, the Concurrent Augmented Transition Network (cATN), that validates the concept’s feasibility in a series of proof of concept demonstrations as well as through a comparative benchmark. The cATN fulfills all identified requirements and fills the lack amongst previous solutions. It supports the rapid prototyping of multimodal interfaces by means of five concrete traits: Its declarative nature, the recursiveness of the underlying transition network, the network abstraction constructs of its description language, the utilized semantic queries, and an abstraction layer for lexical information. Our reference implementation was and is used in various student projects, theses, as well as master-level courses. It is openly available and showcases that non-experts can effectively implement multimodal interfaces, even for non-trivial applications in mixed and virtual reality.","PeriodicalId":52297,"journal":{"name":"Multimodal Technologies and Interaction","volume":"7 1","pages":"81"},"PeriodicalIF":2.5,"publicationDate":"2018-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.3390/MTI2040081","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69756311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

A Phenomenological Framework of Architectural Paradigms for the User-Centered Design of Virtual Environments 以用户为中心的虚拟环境设计的建筑范式现象学框架

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-11-30 DOI: 10.3390/MTI2040080

Matthew E. Gladden

{"title":"A Phenomenological Framework of Architectural Paradigms for the User-Centered Design of Virtual Environments","authors":"Matthew E. Gladden","doi":"10.3390/MTI2040080","DOIUrl":"https://doi.org/10.3390/MTI2040080","url":null,"abstract":"In some circumstances, immersion in virtual environments with the aid of virtual reality (VR) equipment can create feelings of anxiety in users and be experienced as something “frightening”, “oppressive”, “alienating”, “dehumanizing”, or “dystopian”. Sometimes (e.g., in exposure therapy or VR gaming), a virtual environment is intended to have such psychological impacts on users; however, such effects can also arise unintentionally due to the environment’s poor architectural design. Designers of virtual environments may employ user-centered design (UCD) to incrementally improve a design and generate a user experience more closely resembling the type desired; however, UCD can yield suboptimal results if an initial design relied on an inappropriate architectural approach. This study developed a framework that can facilitate the purposeful selection of the most appropriate architectural approach by drawing on Norberg-Schulz’s established phenomenological account of real-world architectural modes. By considering the unique possibilities for structuring and experiencing space within virtual environments and reinterpreting Norberg-Schulz’s schemas in the context of virtual environment design, a novel framework was formulated that explicates six fundamental “architectural paradigms” available to designers of virtual environments. It was shown that the application of this framework could easily be incorporated as an additional step within the UCD process.","PeriodicalId":52297,"journal":{"name":"Multimodal Technologies and Interaction","volume":"2 1","pages":"80"},"PeriodicalIF":2.5,"publicationDate":"2018-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.3390/MTI2040080","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69756300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

"There Was No Green Tick": Discovering the Functions of a Widget in a Joint Problem-Solving Activity and the Consequences for the Participants' Discovering Process “没有绿勾”:在共同解决问题的活动中发现小部件的功能及其对参与者发现过程的影响

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-10-26 DOI: 10.3390/MTI2040076

Patrick Sunnen, Béatrice Arend, V. Maquil

引用次数: 0

A Survey to Understand Emotional Situations on the Road and What They Mean for Affective Automotive UIs 了解道路上的情绪状况及其对情感汽车ui的意义的调查

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-10-25 DOI: 10.3390/MTI2040075

Michael Braun, Bastian Pfleging, Florian Alt

{"title":"A Survey to Understand Emotional Situations on the Road and What They Mean for Affective Automotive UIs","authors":"Michael Braun, Bastian Pfleging, Florian Alt","doi":"10.3390/MTI2040075","DOIUrl":"https://doi.org/10.3390/MTI2040075","url":null,"abstract":"In this paper, we present the results of an online survey (N = 170) on emotional situations on the road. In particular, we asked potential early adopters to remember a situation where they felt either an intense positive or negative emotion while driving. Our research is motivated by imminent disruptions in the automotive sector due to automated driving and the accompanying switch to selling driving experiences over horsepower. This creates a need to focus on the driver’s emotion when designing in-car interfaces. As a result of our research, we present a set of propositions for affective car interfaces based on real-life experiences. With our work we aim to support the design of affective car interfaces and give designers a foundation to build upon. We find respondents often connect positive emotions with enjoying their independence, while negative experiences are associated mostly with traffic behavior. Participants who experienced negative situations wished for better information management and a higher degree of automation. Drivers with positive emotions generally wanted to experience the situation more genuinely, for example, by switching to a “back-to-basic” mode. We explore these statements and discuss recommendations for the design of affective interfaces in future cars.","PeriodicalId":52297,"journal":{"name":"Multimodal Technologies and Interaction","volume":"2 1","pages":"75"},"PeriodicalIF":2.5,"publicationDate":"2018-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.3390/MTI2040075","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69756057","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 17

Modelling Adaptation through Social Allostasis: Modulating the Effects of Social Touch with Oxytocin in Embodied Agents 通过社会不平衡模拟适应:调节社会接触与催产素在具身代理中的作用

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-10-03 DOI: 10.3390/MTI2040067

Imran Khan, Lola Cañamero

{"title":"Modelling Adaptation through Social Allostasis: Modulating the Effects of Social Touch with Oxytocin in Embodied Agents","authors":"Imran Khan, Lola Cañamero","doi":"10.3390/MTI2040067","DOIUrl":"https://doi.org/10.3390/MTI2040067","url":null,"abstract":"Social allostasis is a mechanism of adaptation that permits individuals to dynamically adapt their physiology to changing physical and social conditions. Oxytocin (OT) is widely considered to be one of the hormones that drives and adapts social behaviours. While its precise effects remain unclear, two areas where OT may promote adaptation are by affecting social salience, and affecting internal responses of performing social behaviours. Working towards a model of dynamic adaptation through social allostasis in simulated embodied agents, and extending our previous work studying OT-inspired modulation of social salience, we present a model and experiments that investigate the effects and adaptive value of allostatic processes based on hormonal (OT) modulation of affective elements of a social behaviour. In particular, we investigate and test the effects and adaptive value of modulating the degree of satisfaction of tactile contact in a social motivation context in a small simulated agent society across different environmental challenges (related to availability of food) and effects of OT modulation of social salience as a motivational incentive. Our results show that the effects of these modulatory mechanisms have different (positive or negative) adaptive value across different groups and under different environmental circumstance in a way that supports the context-dependent nature of OT, put forward by the interactionist approach to OT modulation in biological agents. In terms of simulation models, this means that OT modulation of the mechanisms that we have described should be context-dependent in order to maximise viability of our socially adaptive agents, illustrating the relevance of social allostasis mechanisms.","PeriodicalId":52297,"journal":{"name":"Multimodal Technologies and Interaction","volume":"41 1","pages":"67"},"PeriodicalIF":2.5,"publicationDate":"2018-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.3390/MTI2040067","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69755897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

A Two-Study Approach to Explore the Effect of User Characteristics on Users' Perception and Evaluation of a Virtual Assistant's Appearance 两项研究方法探讨用户特征对用户感知和评价虚拟助手外观的影响

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-10-02 DOI: 10.3390/MTI2040066

Carolin Straßmann, N. Krämer

{"title":"A Two-Study Approach to Explore the Effect of User Characteristics on Users' Perception and Evaluation of a Virtual Assistant's Appearance","authors":"Carolin Straßmann, N. Krämer","doi":"10.3390/MTI2040066","DOIUrl":"https://doi.org/10.3390/MTI2040066","url":null,"abstract":"This research investigates the effect of different user characteristics on the perception and evaluation of an agent’s appearance variables. Therefore, two different experiments have been conducted. In a 3 × 3 × 5 within-subjects design (Study 1; N = 59), three different target groups (students, elderly, and cognitively impaired people) evaluated 30 different agent appearances that varied in species (human, animal, and robot) and realism (high detail, low detail, stylized shades, stylized proportion, and stylized shade with stylized proportion). Study 2 (N = 792) focused on the effect of moderating variables regarding the same appearance variables and aims to supplement findings of Study 1 based on a 3 × 5 between-subjects design. Results showed effects of species and realism on person perception, users’ liking, and using intention. In a direct comparison, a higher degree of realism was perceived as more positive, while those effects were not replicated in Study 2. Further on, a majority evaluated nonhumanoid agents more positively. Since no interaction effects of species and realism have been found, the effects of stylization seem to equally influence the perception for all kind of species. Moreover, the importance of the target group’s preference was demonstrated, since differences with regard to the appearance evaluation were found.","PeriodicalId":52297,"journal":{"name":"Multimodal Technologies and Interaction","volume":"378 1","pages":"66"},"PeriodicalIF":2.5,"publicationDate":"2018-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.3390/MTI2040066","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69756128","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Designing Behavioural Artificial Intelligence to Record, Assess and Evaluate Human Behaviour 设计行为人工智能来记录、评估和评估人类行为

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-09-25 DOI: 10.3390/mti2040063

H. Hildmann

{"title":"Designing Behavioural Artificial Intelligence to Record, Assess and Evaluate Human Behaviour","authors":"H. Hildmann","doi":"10.3390/mti2040063","DOIUrl":"https://doi.org/10.3390/mti2040063","url":null,"abstract":"The context of the work presented in this article is the assessment and automated evaluation of human behaviour. To facilitate this, a formalism is presented which is unambiguous as well as such that it can be implemented and interpreted in an automated manner. In the greater scheme of things, comparable behaviour evaluation requires comparable assessment scenarios and, to this end, computer games are considered as controllable and abstract environments. Within this context, a model for behavioural AI is presented which was designed around the objectives of: (a) being able to play rationally; (b) adhering to formally stated behaviour preferences; and (c) ensuring that very specific circumstances can be forced to arise within a game. The presented work is based on established models from the field of behavioural psychology, formal logic as well as approaches from game theory and related fields. The suggested model for behavioural AI has been used to implement and test a game, as well as AI players that exhibit specific behavioural preferences. The overall aim of this article is to enable the readers to design their own AI implementation, using the formalisms and models they prefer and to a level of complexity they desire.","PeriodicalId":52297,"journal":{"name":"Multimodal Technologies and Interaction","volume":"12 1","pages":"63"},"PeriodicalIF":2.5,"publicationDate":"2018-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.3390/mti2040063","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69756099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Effect of Sensory Feedback on Turn-Taking Using Paired Devices for Children with ASD 感觉反馈对ASD儿童使用配对设备轮流的影响

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-09-20 DOI: 10.3390/MTI2040061

Eleuda Nuñez, Soichiro Matsuda, Masakazu Hirokawa, Jun-ichi Yamamoto, Kenji Suzuki

{"title":"Effect of Sensory Feedback on Turn-Taking Using Paired Devices for Children with ASD","authors":"Eleuda Nuñez, Soichiro Matsuda, Masakazu Hirokawa, Jun-ichi Yamamoto, Kenji Suzuki","doi":"10.3390/MTI2040061","DOIUrl":"https://doi.org/10.3390/MTI2040061","url":null,"abstract":"Most children can naturally engage in play and by this, develop skills while interacting with their peers and toys. However, children with Autism Spectrum Disorder (ASD) often show impairments in play skills which result in limited opportunities for interaction with others and the learning of social skills. In this regard, robotic devices/toys that can provide simple and attractive indications are advantageous to engage children with ASD in play activities that require social and interaction skills. This project proposes a new interaction method using paired robotic devices called COLOLO to facilitate a fundamental exchange of intention in communication so-called turn-taking. These tangible devices are designed to sense the user’s manipulation, send a message to the paired device, and display visual cues for assisting children to achieve turn-taking through play. On the sessions with COLOLO there are two devices, one held by the therapist and one by the child, and they take turns to manipulate the toys and change their colors. In this article, two experimental conditions or interaction rules: the “two-sided lighting rule” and the “one-sided lighting rule\" were introduced. The two interactions rules differ from each on the way the devices used the visual cues to indicate the turn-holder. The effect of each interaction rule on children’s turn-taking behaviors was investigated through an experimental study with four children with ASD. From the results, we found that with the one-sided lighting rule participants tended to shift their gaze more and to decrease the failed attempts of turn-taking. The discussion covers the possibilities of using paired devices to describe participants’ behaviors related to turn-taking quantitatively.","PeriodicalId":52297,"journal":{"name":"Multimodal Technologies and Interaction","volume":"2 1","pages":"61"},"PeriodicalIF":2.5,"publicationDate":"2018-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.3390/MTI2040061","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69756090","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Perceptions on Authenticity in Chat Bots 对聊天机器人真实性的看法

IF 2.5

Multimodal Technologies and Interaction Pub Date : 2018-09-17 DOI: 10.3390/MTI2030060

Mario Neururer, Stephan Schlögl, Luisa Brinkschulte, Aleksander Groth

{"title":"Perceptions on Authenticity in Chat Bots","authors":"Mario Neururer, Stephan Schlögl, Luisa Brinkschulte, Aleksander Groth","doi":"10.3390/MTI2030060","DOIUrl":"https://doi.org/10.3390/MTI2030060","url":null,"abstract":"In 1950, Alan Turing proposed his concept of universal machines, emphasizing their abilities to learn, think, and behave in a human-like manner. Today, the existence of intelligent agents imitating human characteristics is more relevant than ever. They have expanded to numerous aspects of daily life. Yet, while they are often seen as work simplifiers, their interactions usually lack social competence. In particular, they miss what one may call authenticity. In the study presented in this paper, we explore how characteristics of social intelligence may enhance future agent implementations. Interviews and an open question survey with experts from different fields have led to a shared understanding of what it would take to make intelligent virtual agents, in particular messaging agents (i.e., chat bots), more authentic. Results suggest that showcasing a transparent purpose, learning from experience, anthropomorphizing, human-like conversational behavior, and coherence, are guiding characteristics for agent authenticity and should consequently allow for and support a better coexistence of artificial intelligence technology with its respective users.","PeriodicalId":52297,"journal":{"name":"Multimodal Technologies and Interaction","volume":"2 1","pages":"60"},"PeriodicalIF":2.5,"publicationDate":"2018-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.3390/MTI2030060","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69755935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 38