{"title":"Interruptions in Human-Agent Interaction","authors":"Liu Yang, C. Achard, C. Pelachaud","doi":"10.1145/3472306.3478340","DOIUrl":"https://doi.org/10.1145/3472306.3478340","url":null,"abstract":"Turn management is one of the necessary social interactions skills. In human-human interactions, turn changes are naturally completed by interruption, \"cooperatively\" or \"competitively\". Interruptions are inherent in conversation. They can be considered disruptive at first glance, but can also be cooperative and participate to enriching the interaction. To create natural human-agent interaction, Embodied Conversational Agent (ECA) should be able to communicate autonomously with humans both verbally and nonverbally. A challenge is then to handle interruptions during their interaction. This article presents our ongoing work to endow ECA to manage interruption during the interaction with a human partner. In order to achieve this goal, we start by analyzing human-human interaction data.","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130110893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Bönsch, David Hashem, Jonathan Ehret, T. Kuhlen
{"title":"Being Guided or Having Exploratory Freedom: User Preferences of a Virtual Agent's Behavior in a Museum","authors":"A. Bönsch, David Hashem, Jonathan Ehret, T. Kuhlen","doi":"10.1145/3472306.3478339","DOIUrl":"https://doi.org/10.1145/3472306.3478339","url":null,"abstract":"A virtual guide in an immersive virtual environment allows users a structured experience without missing critical information. However, although being in an interactive medium, the user is only a passive listener, while the embodied conversational agent (ECA) fulfills the active roles of wayfinding and conveying knowledge. Thus, we investigated for the use case of a virtual museum, whether users prefer a virtual guide or a free exploration accompanied by an ECA who imparts the same information compared to the guide. Results of a small within-subjects study with ahead-mounted display are given and discussed, resulting in the idea of combining benefits of both conditions for a higher user acceptance. Furthermore, the study indicated the feasibility of the carefully designed scene and ECA's appearance.","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121771445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Attention-Guidance Method Based on Conforming Behavior of Multiple Virtual Agents for Pedestrians","authors":"Naoto Yoshida, Tomoko Yonezawa","doi":"10.1145/3472306.3478346","DOIUrl":"https://doi.org/10.1145/3472306.3478346","url":null,"abstract":"Humans observe the behavior of others and exhibit conforming behavior according to the situation. In this study, we propose a method to change the user's walking behavior and attention by changing the ratio of multiple virtual agents in action. We verified whether the attention to a poster on the wall and the walking behavior of a pedestrian changed according to the type and proportion of actions exhibited by multiple agents presented to a particular pedestrian. The results showed that the participant's walking speed and attention to the wall advertisement changed according to the agents' walking behavior, such as deceleration and stopping.","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126868636","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shiri Sadeh-Sharvit, J. Giron, Shir Fridman, M. Hanrieder, Shany Goldstein, D. Friedman, Shir Brokman
{"title":"Virtual Reality in Sexual Harassment Prevention: Proof-of-Concept Study","authors":"Shiri Sadeh-Sharvit, J. Giron, Shir Fridman, M. Hanrieder, Shany Goldstein, D. Friedman, Shir Brokman","doi":"10.1145/3472306.3478356","DOIUrl":"https://doi.org/10.1145/3472306.3478356","url":null,"abstract":"Sexual harassment (SH) training is a major public health priority, and available programs show limited efficacy. We present a new application for virtual agents in virtual reality (VR), which has the potential to deliver SH training that imitates real world scenarios and is yet safe. We conducted a proof-of-concept study to examine whether a VR simulation of a job interview during which the interviewer, a semi-automated virtual agent, sexually harasses the interviewee is an effective practice tool for women, and could serve as the basis for developing skills for effective response. Five females (24-25 years old) participated in this VR scenario and were then interviewed about their reactions to the VR scenario and the virtual agent. Four main themes emerged: paralysis and fear, uncertainty how to respond, resurfacing of previous SH experiences, and VR as an effective training tool for preventing SH. Findings suggest that contemporary virtual agents in VR can induce the sense of being harassed, similar to real humans. VR offers a safe exposure for SH and may serve as a learning platform to empower women in considering and practicing more effective responses to future SH experiences.","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"57 ","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120867570","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Prasanth Murali, H. Trinh, Lazlo Ring, T. Bickmore
{"title":"A Friendly Face in the Crowd: Reducing Public Speaking Anxiety with an Emotional Support Agent in the Audience","authors":"Prasanth Murali, H. Trinh, Lazlo Ring, T. Bickmore","doi":"10.1145/3472306.3478364","DOIUrl":"https://doi.org/10.1145/3472306.3478364","url":null,"abstract":"We present Friendly Face - a virtual agent designed to reduce public speaking anxiety by standing within an audience. The agent senses the speaker's behavior during an oral presentation and provides emotional and instrumental support. The system unobtrusively tracks the motion, speech, and prosody of the presenter and provides an intuitive interface to give supportive feedback whenever the presenter looks at the agent, attentive listening behavior through agent gaze and backchannel listening behavior, and time and topic cueing based on real-time analysis of speech content compared to presentation slide contents. An evaluation of Friendly Face agent with a functionally equivalent control system demonstrated that the agent system led to significant reductions in public speaking anxiety compared to a control condition, assessed both objectively with physiological measures and validated self-report instruments.","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133597024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
T. Bickmore, Dhaval Parmar, Everlyne Kimani, S. Ólafsson
{"title":"Diversity Informatics: Reducing Racial and Gender Bias with Virtual Agents","authors":"T. Bickmore, Dhaval Parmar, Everlyne Kimani, S. Ólafsson","doi":"10.1145/3472306.3478365","DOIUrl":"https://doi.org/10.1145/3472306.3478365","url":null,"abstract":"Job advertisements in white male-dominated organizations are often biased in ways that discourage female and minority candidates from applying. We explored the use of a female African American virtual agent who provides a first-person reaction to a biased job advertisement, providing an impassioned, vivid description of her feelings about the advertisement, the position, and the organization offering the job, and how the position---as described---would impact her life were she to take the job. We evaluate the impact interactions with this agent have on the effort study participants invest in editing the job advertisement following their interaction with the agent, compared to reading a page of standard educational text on diversity in hiring. Participants who interacted with the agent spent significantly more effort correcting the job ad, as measured both by the number of edit operations and the number of biased phrases removed, compared to participants in the control condition. Implications and a future research agenda for increasing diversity using virtual agents are presented.","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"79 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114448493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Social Signals of Cohesion in Multi-party Interactions","authors":"R. Kantharaju, C. Pelachaud","doi":"10.1145/3472306.3478362","DOIUrl":"https://doi.org/10.1145/3472306.3478362","url":null,"abstract":"Group conversation is a frequently used form of communication for exchanging ideas and making decisions. Cohesion is an emergent phenomenon that describes the members' attraction towards the group and towards working together. In this paper, we present the cohesion labels assigned to segments from [redacted], a multimodal dataset of simulated medical consultations. Then, we present the analysis performed to identify social cues that characterize cohesion and report the accuracy for classifying cohesion. Results show that non-verbal social cues like gaze, facial AUs, laughter etc., indeed convey information regarding the level of cohesion. Finally we present a preliminary evaluation conducted using the prominent cues to simulate a cohesive group of agents.","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116957156","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Designing Personality Shifting Agent for Speech Recognition Failure","authors":"Tatsuki Hori, Kazuki Kobayashi","doi":"10.1145/3472306.3478347","DOIUrl":"https://doi.org/10.1145/3472306.3478347","url":null,"abstract":"This paper proposes a method to shift an agent's personality during speech interaction to reduce users' negative impressions of speech recognition systems when speech recognition fails. Speech recognition failure makes users uncomfortable, and the cognitive strain in rephrasing commands is high. The proposed method aims to eliminate users' negative impression of agents by allowing an agent to have multiple personalities and accept responsibility for the failure, with the personality responsible for failure being removed from the task. System hardware remains the same, and users can continue to interact with another personality of the agent. Shifting the agent's personality is represented by a change in voice tone and LED color. Experimental results suggested that the proposed method reduces users' negative impressions by improving communication between users and the agent.","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114910526","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hedieh Ranjbartabar, Deborah Richards, A. Bilgin, C. Kutay
{"title":"Do you mind if I ask?: Addressing the cold start problem in personalised relational agent conversation","authors":"Hedieh Ranjbartabar, Deborah Richards, A. Bilgin, C. Kutay","doi":"10.1145/3472306.3478357","DOIUrl":"https://doi.org/10.1145/3472306.3478357","url":null,"abstract":"To personalise dialogue to different users, relational agents need to learn about the users' preferences for relational cues used by the agent. In the context of a virtual advisor to reduce students' study stress, we designed a between subjects study with three groups (empathic, neutral and adaptive) who either received all cues, no cues or helpful cues only, respectively, and compared rapport and changes in study stress scores. To avoid the cold start problem, we sought to train the agent and adapt its dialogue to include or exclude 10 relational cues based on the user's responses to whether an example of each relational cue is found helpful prior to the session with the virtual advisor. The results of an experiment with 111 students show that the rapport scores for the empathic and adaptive groups were significantly higher than the neutral group; change in rapport scores was significantly higher in the adaptive group than in the empathic group. Furthermore, study stress scores significantly reduced for the adaptive and empathic groups, but not for the neutral group. We found some relationships between the number of times students found helpful what they received and other variables. We also found that the number of discrepancies and matches between what relational cues users received and what they found helpful were greatest in the adaptive group. This indicates the effectiveness of this approach for dealing with the cold start problem.","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"103 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124177975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ylva Ferstl, S. Thomas, Cédric Guiard, Cathy Ennis, R. Mcdonnell
{"title":"Human or Robot?: Investigating voice, appearance and gesture motion realism of conversational social agents","authors":"Ylva Ferstl, S. Thomas, Cédric Guiard, Cathy Ennis, R. Mcdonnell","doi":"10.1145/3472306.3478338","DOIUrl":"https://doi.org/10.1145/3472306.3478338","url":null,"abstract":"Research on creation of virtual humans enables increasing automatization of their behavior, including synthesis of verbal and nonverbal behavior. As the achievable realism of different aspects of agent design evolves asynchronously, it is important to understand if and how divergence in realism between behavioral channels can elicit negative user responses. Specifically, in this work, we investigate the question of whether autonomous virtual agents relying on synthetic text-to-speech voices should portray a corresponding level of realism in the non-verbal channels of motion and visual appearance, or if, alternatively, the best available realism of each channel should be used. In two perceptual studies, we assess how realism of voice, motion, and appearance influence the perceived match of speech and gesture motion, as well as the agent's likability and human-likeness. Our results suggest that maximizing realism of voice and motion is preferable even when this leads to realism mismatches, but for visual appearance, lower realism may be preferable. (A video abstract can be found at https://youtu.be/arfZZ-hxD1Y.)","PeriodicalId":148152,"journal":{"name":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128303569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}