A. Imashev, Nurziya Oralbayeva, V. Kimmelman, A. Sandygulova
{"title":"A User-Centered Evaluation of the Data-Driven Sign Language Avatar System: A Pilot Study","authors":"A. Imashev, Nurziya Oralbayeva, V. Kimmelman, A. Sandygulova","doi":"10.1145/3527188.3561923","DOIUrl":"https://doi.org/10.1145/3527188.3561923","url":null,"abstract":"Sign Languages (SL) are a form of communication in the visual-gestural modality, and are full-fledged natural languages. Recent years have witnessed the increase in the use of virtual avatars as virtual assistants. Research into sign language recognition has demonstrated promising potential for robust automatic sign language recognition. However, the area of sign language synthesis is still in its infancy. This explains the underdevelopment of virtual intelligent signing systems. Additionally, existing models are often restricted to manually written rules and require expert knowledge, while data-driven approach could provide a better solution. Apart from the development of signing systems, research indicates a gap in the evaluation thereof by sign language users. In this paper, we propose a data-driven sign language interpreting avatar and its subjective evaluation. We present findings from a pilot study with the deaf evaluating two different avatars against a human sign language interpreter using the metrics that are believed to bring out important insights and narratives for the users in terms of their perceptions of the avatars.","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114418734","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"“I Have No Idea What a Social Bot Is”: On Users’ Perceptions of Social Bots and Ability to Detect Them","authors":"Daniel Kats, Mahmood Sharif","doi":"10.1145/3527188.3561928","DOIUrl":"https://doi.org/10.1145/3527188.3561928","url":null,"abstract":"Social bots—software agents controlling accounts on online social networks (OSNs)—have been employed for various malicious purposes, including spreading disinformation and scams. Understanding user perceptions of bots and ability to distinguish them from other accounts can inform mitigations. To this end, we conducted an online study with 297 users of seven OSNs to explore their mental models of bots and evaluate their ability to classify bots and non-bots correctly. We found that while some participants were aware of bots’ primary characteristics, others provided abstract descriptions or confused bots with other phenomena. Participants also struggled to classify accounts correctly (e.g., misclassifying > 50% of accounts) and were more likely to misclassify bots than non-bots. Furthermore, we observed that perceptions of bots had a significant effect on participants’ classification accuracy. For example, participants with abstract perceptions of bots were more likely to misclassify. Informed by our findings, we discuss directions for developing user-centered interventions against bots.","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127190470","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Perspective-taking of Virtual Agents for Promoting Prosocial Behaviors","authors":"Chen Hang, T. Ono, S. Yamada","doi":"10.1145/3527188.3563932","DOIUrl":"https://doi.org/10.1145/3527188.3563932","url":null,"abstract":"Abstract Perspective-taking, which enables people to imagine another’s thinking and goals, is known to be effective for promoting prosocial behaviors in human-computer interactions. However, most previous studies have focused on simulating human-human interactions in the real world by offering participants experiences related to various moral tasks through the use of human-like virtual agents. In this study, we investigated whether taking the perspective of different robots in a robot-altruistic task would influence the social behaviors of participants in a dictator game. Our findings showed that participants who watched the help-receiver view behaved more altruistically toward a robot than those who watched the help-provider view.","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127811950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Najjar, Nina Hosseini-Kivanani, Igor Tchappi Haman, Yazan Mualla, Egberdien Van der Peijl, Daniel Karpati, Christoph Schommer
{"title":"XAI: Using Smart Photobooth for Explaining History of Art","authors":"A. Najjar, Nina Hosseini-Kivanani, Igor Tchappi Haman, Yazan Mualla, Egberdien Van der Peijl, Daniel Karpati, Christoph Schommer","doi":"10.1145/3527188.3563914","DOIUrl":"https://doi.org/10.1145/3527188.3563914","url":null,"abstract":"The rise of Artificial Intelligence has led to advancements in daily life, including applications in industries, telemedicine, farming, and smart cities. It is necessary to have human-AI synergies to guarantee user engagement and provide interactive expert knowledge, despite AI’s success in \"less technical\" fields. In this article, the possible synergies between humans and AI to explain the development of art history and artistic style transfer are discussed. This study is part of the \"Smart Photobooth\" project that is able to automatically transform a user’s picture into a well-known artistic style as an interactive approach to introduce the fundamentals of the history of art to the common people and provide them with a concise explanation of the various art painting styles. This study investigates human-AI synergies by combining the explanation produced by an explainable AI mechanism with a human expert’s insights to provide reasons for school students and a larger audience.","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130621948","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring Factors Affecting User Trust Across Different Human-Robot Interaction Settings and Cultures","authors":"Abdullah Alzahrani, Simon Robinson, M. Ahmad","doi":"10.1145/3527188.3561920","DOIUrl":"https://doi.org/10.1145/3527188.3561920","url":null,"abstract":"Trust is one of the necessary factors for building a successful human-robot interaction (HRI). This paper investigated how human trust in robots differs across HRI scenarios in two cultures. We conducted two studies in two countries: Saudi Arabia (study 1) and the United Kingdom (study 2). Each study presented three HRI scenarios: a dog robot guiding people with sight impairments, a teleoperated robot in healthcare, and a manufacturing robot. Study 1 shows that participants’ trust perception score (TPS) was significantly different across the three scenarios. However, Study 2 results show a slightly significant variation in TPS across the scenarios. We also found that the relevance of trust for a given task is an indicator of a participant’s trust. Furthermore, the findings showed that trust scores or factors affecting users’ trust vary across cultures. The findings identified novel factors that might affect human trust, such as controllability, usability and risk. The findings direct the HRI community to consider a dynamic and evolving design for modelling human-robot trust because factors affecting humans’ trust are evolving and will vary across different settings and cultures.","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126842928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Can Vicarious Agents follow the Intent of Clients’ Orders in Making Risk Judgments?","authors":"Yuri Sato, Haruaki Fukuda, Kazuhiro Ueda","doi":"10.1145/3527188.3563912","DOIUrl":"https://doi.org/10.1145/3527188.3563912","url":null,"abstract":"Vicarious decisions are made on behalf of others that are not for the decision-makers themselves, but for the satisfaction of the others. They are often observed in interactive situations in the real-world, such as investment trusts in an outsourced agency (planners) and its clients (sponsors). We challenged the question of whether planners really could follow the intent of sponsors’ orders in making vicarious risk decisions. We designed and conducted an online experiment in which pairs of persons interacted with each other in the role of either sponsor or planner. Our results showed that planners adjusted the number of gambling or risky choices according to the sponsor’s orders, but did not take actions that reflected the sponsor’s risk preferences; nonetheless, sponsor’s satisfaction to the planner’s choice was substantially high. These findings shed light on the interaction design of how deeply vicarious agents (whether human or robot) should follow the client’s thoughts in collaborative tasks.","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127039121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Carolyn Saund, Haley Matuszak, Anna Weinstein, Stacy Marsella
{"title":"Motion and Meaning: Data-Driven Analyses of The Relationship Between Gesture and Communicative Semantics","authors":"Carolyn Saund, Haley Matuszak, Anna Weinstein, Stacy Marsella","doi":"10.1145/3527188.3561941","DOIUrl":"https://doi.org/10.1145/3527188.3561941","url":null,"abstract":"Gestures convey critical information within social interactions. As such, the success of virtual agents (VA) in both building social relationships and achieving their goals is heavily dependent on the information conveyed within their gestures. Because of the precision required for effective gesture behavior, it is prudent to retain some designer control over these conversational gestures. However, in order to exercise that control practically we must first understand how gestural motion conveys meaning. One consideration in this relationship between motion and meaning is the notion of Ideational Units, meaning that only parts of a gesture’s motion at a point in time may convey meaning, while other parts may be held from the previous gesture. In this paper, we develop, demonstrate, and release a set of tools that help quantify the relationship between the semantics conveyed in a gesture’s co-speech utterance and the fine-grained motion of that gesture. This allows us to explore insights into the complex relationship between motion and meaning. In particular, we use spectral motion clustering to discern patterns of motion that tend to be associated with semantic concepts, on both an aggregate and individual-speaker level. We then discuss the potential for these tools to serve as a framework for both automated gesture generation and interpretation in virtual agents. These tools can ideally be used within approaches to automating VA gesture performances as well as serve as an analysis framework for fundamental gesture research.","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126605734","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Qinglei Bu, Xiaoyi Cheng, Fan Yang, Jie Sun, Limin Yu, Ying Hou
{"title":"A Computer Game-based Tangible Upper Limb Rehabilitation Device","authors":"Qinglei Bu, Xiaoyi Cheng, Fan Yang, Jie Sun, Limin Yu, Ying Hou","doi":"10.1145/3527188.3563919","DOIUrl":"https://doi.org/10.1145/3527188.3563919","url":null,"abstract":"In order to regain the motor control of upper limbs, stroke patients should go through various exercises to resume finger, hand and arm functions. During such exercises, they need constant assistance, guidance and support from either therapists or caregivers. Due to the increase of aging population, the demand for technology support in home-based stroke recovery has rapidly increased in the last decade. This paper presents an interactive prototype designed to facilitate finger grasping, hand gripping and arm reaching exercises at home. It consists of a portable device with light, audio feedback and a computer game with two scenes and visual guidance. Preliminary usability testing in the community with elderly persons indicates that this device is easy to follow, and enjoyable to play. These trials explore the possibility and feasibility of implementing such tangible interactive training at home or in community rehab centers, inspiring us to improve such designs further to support active rehabilitation.","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114571398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Cassandra L. Crone, Grace Chamberlin, Kyle Aspinall, Gaurav Patil, Michael J. Richardson, Rachel W. Kallen
{"title":"Embodied Virtual Interactions: What Does Equity Mean to You?: Preliminary Results for the Impact of Transgender Avatar Embodiment on Empathy","authors":"Cassandra L. Crone, Grace Chamberlin, Kyle Aspinall, Gaurav Patil, Michael J. Richardson, Rachel W. Kallen","doi":"10.1145/3527188.3563922","DOIUrl":"https://doi.org/10.1145/3527188.3563922","url":null,"abstract":"Embodied virtual interactions can contribute to more immersive perspective taking experiences, which in turn can increase empathy and affiliation. This study sought to investigate these outcomes in the context of unconscious bias related to gender identity during interpersonal interactions. We conducted a simulated interview in virtual reality, in which participants embodied a transgender or cisgender avatar and interacted with a human-controlled agent (transgender woman). Preliminary results reveal differences between women and men in their experiences of empathy and emotional state when embodied as a transgender avatar.","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121648018","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Who Would You like to Deliver your Healthcare?","authors":"Eliza Broadbent","doi":"10.1145/3527188.3565964","DOIUrl":"https://doi.org/10.1145/3527188.3565964","url":null,"abstract":"","PeriodicalId":179256,"journal":{"name":"Proceedings of the 10th International Conference on Human-Agent Interaction","volume":"92 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123437175","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}