International Journal of Human-Computer Studies最新文献

{"title":"Information that matters: Exploring information needs of people affected by algorithmic decisions","authors":"Timothée Schmude ,&nbsp;Laura Koesten ,&nbsp;Torsten Möller ,&nbsp;Sebastian Tschiatschek","doi":"10.1016/j.ijhcs.2024.103380","DOIUrl":"10.1016/j.ijhcs.2024.103380","url":null,"abstract":"<div><div>Every AI system that makes decisions about people has a group of stakeholders that are personally affected by these decisions. However, explanations of AI systems rarely address the information needs of this stakeholder group, who often are AI novices. This creates a gap between conveyed information and information that matters to those who are impacted by the system’s decisions, such as domain experts and decision subjects. To address this, we present the “XAI Novice Question Bank”, an extension of the XAI Question Bank (Liao et al., 2020) containing a catalog of information needs from AI novices in two use cases: employment prediction and health monitoring. The catalog covers the categories of data, system context, system usage, and system specifications. We gathered information needs through task based interviews where participants asked questions about two AI systems to decide on their adoption and received verbal explanations in response. Our analysis showed that participants’ confidence increased after receiving explanations but that their understanding faced challenges. These included difficulties in locating information and in assessing their own understanding, as well as attempts to outsource understanding. Additionally, participants’ prior perceptions of the systems’ risks and benefits influenced their information needs. Participants who perceived high risks sought explanations about the intentions behind a system’s deployment, while those who perceived low risks rather asked about the system’s operation. Our work aims to support the inclusion of AI novices in explainability efforts by highlighting their information needs, aims, and challenges. We summarize our findings as five key implications that can inform the design of future explanations for lay stakeholder audiences.</div></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142428324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Comprehension is a double-edged sword: Over-interpreting unspecified information in intelligible machine learning explanations","authors":"Yueqing Xuan ,&nbsp;Edward Small ,&nbsp;Kacper Sokol ,&nbsp;Danula Hettiachchi ,&nbsp;Mark Sanderson","doi":"10.1016/j.ijhcs.2024.103376","DOIUrl":"10.1016/j.ijhcs.2024.103376","url":null,"abstract":"<div><div>Automated decision-making systems are becoming increasingly ubiquitous, which creates an immediate need for their interpretability and explainability. However, it remains unclear whether users know what insights an explanation offers and, more importantly, what information it lacks. To answer this question we conducted an online study with 200 participants, which allowed us to assess explainees’ ability to realise <em>explicated information</em> – i.e., factual insights conveyed by an explanation – and <em>unspecified information</em> – i.e, insights that are not communicated by an explanation – across four representative explanation types: model architecture, decision surface visualisation, counterfactual explainability and feature importance. Our findings uncover that highly comprehensible explanations, e.g., feature importance and decision surface visualisation, are exceptionally susceptible to misinterpretation since users tend to infer spurious information that is outside of the scope of these explanations. Additionally, while the users gauge their confidence accurately with respect to the information explicated by these explanations, they tend to be overconfident when misinterpreting the explanations. Our work demonstrates that human comprehension can be a double-edged sword since highly accessible explanations may convince users of their truthfulness while possibly leading to various misinterpretations at the same time. Machine learning explanations should therefore carefully navigate the complex relation between their full scope and limitations to maximise understanding and curb misinterpretation.</div></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142319173","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Human-machine plan conflict and conflict resolution in a visual search task","authors":"Yunxian Pan ,&nbsp;Jie Xu","doi":"10.1016/j.ijhcs.2024.103377","DOIUrl":"10.1016/j.ijhcs.2024.103377","url":null,"abstract":"<div><div>With rapid technological development, humans are more likely to cooperatively work with intelligence systems in everyday life and work. Similar to interpersonal teamwork, the effectiveness of human-machine teams is affected by conflicts. Some human-machine conflict scenarios occur when neither the human nor the system was at fault, for example, when the human and the system formulated different but equally effective plans to achieve the same goal. In this study, we conducted two experiments to explore the effects of human-machine plan conflict and the different conflict resolution approaches (human adapting to the system, system adapting to the human, and transparency design) in a computer-aided visual search task. The results of the first experiment showed that when conflicts occurred, the participants reported higher mental load during the task, performed worse, and provided lower subjective evaluations towards the aid. The second experiment showed that all three conflict resolution approaches were effective in maintaining task performance, however, only the transparency design and the human adapting to the system approaches were effective in reducing mental load and improving subjective evaluations. The results highlighted the need to design appropriate human-machine conflict resolution strategies to optimize system performance and user experience.</div></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142315240","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"How do people experience the images created by generative artificial intelligence? An exploration of people's perceptions, appraisals, and emotions related to a Gen-AI text-to-image model and its creations","authors":"Amon Rapp ,&nbsp;Chiara Di Lodovico ,&nbsp;Federico Torrielli ,&nbsp;Luigi Di Caro","doi":"10.1016/j.ijhcs.2024.103375","DOIUrl":"10.1016/j.ijhcs.2024.103375","url":null,"abstract":"<div><p>Generative Artificial Intelligence (Gen-AI) has rapidly advanced in recent years, potentially producing enormous impacts on industries, societies, and individuals in the near future. In particular, Gen-AI text-to-image models allow people to easily create high-quality images possibly revolutionizing human creative practices. Despite their increasing use, however, the broader population's perceptions and understandings of Gen-AI-generated images remain understudied in the Human-Computer Interaction (HCI) community. This study investigates how individuals, including those unfamiliar with Gen-AI, perceive Gen-AI text-to-image (Stable Diffusion) outputs. Study findings reveal that participants appraise Gen-AI images based on their technical quality and fidelity in representing a subject, often experiencing them as either prototypical or strange: these experiences may raise awareness of societal biases and evoke unsettling feelings that extend to the Gen-AI itself. The study also uncovers several “relational” strategies that participants employ to cope with concerns related to Gen-AI, contributing to the understanding of reactions to uncanny technology and the (de)humanization of intelligent agents. Moreover, the study offers design suggestions on how to use the anthropomorphizing of the text-to-image model as design material, and the Gen-AI images as support for critical design sessions.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1071581924001587/pdfft?md5=359a59059de59a754e630f5dbeeba9c9&pid=1-s2.0-S1071581924001587-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142239381","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A gaze-based driver distraction countermeasure: Comparing effects of multimodal alerts on driver's behavior and visual attention","authors":"Jérémy Lachance-Tremblay ,&nbsp;Zoubeir Tkiouat ,&nbsp;Pierre-Majorique Léger ,&nbsp;Ann-Frances Cameron ,&nbsp;Ryad Titah ,&nbsp;Constantinos K. Coursaris ,&nbsp;Sylvain Sénécal","doi":"10.1016/j.ijhcs.2024.103366","DOIUrl":"10.1016/j.ijhcs.2024.103366","url":null,"abstract":"<div><p>This study, introduces and evaluates different countermeasures using real-time eye-tracking data. The countermeasures detect when driver gaze deviates from the road for longer than a predetermined threshold and then redirect the driver's attention back to the road. The countermeasures include bimodal and trimodal alerts using combinations of auditory, tactile, and visual modalities. These countermeasures showcase the utility of adopting eye-tracking technologies in the context of driver monitoring and advanced driver's assistance systems. They enhance safety as a safeguard for the increased use of devices such as in-vehicle infotainment systems. Results show that countermeasures effectively redirect drivers’ attention to the road, with higher on-road gaze time. Additionally, bimodal alerts that include the visual modality are less effective at redirecting participants’ gaze on-road and result in poorer driving performance.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1071581924001496/pdfft?md5=1ec1ba108f246c0b63054749117a8534&pid=1-s2.0-S1071581924001496-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142239306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Impact of interaction technique in interactive data visualisations: A study on lookup, comparison, and relation-seeking tasks","authors":"Niels van Berkel ,&nbsp;Benjamin Tag ,&nbsp;Rune Møberg Jacobsen ,&nbsp;Daniel Russo ,&nbsp;Helen C. Purchase ,&nbsp;Daniel Buschek","doi":"10.1016/j.ijhcs.2024.103359","DOIUrl":"10.1016/j.ijhcs.2024.103359","url":null,"abstract":"<div><p>This paper presents an analysis of different interaction techniques used in interactive data visualisations to support end-users in visual analytics tasks. Our selection of interaction techniques is based on prior work and consists of the interaction techniques <span>Select</span>, <span>Explore</span>, <span>Reconfigure</span>, <span>Encode</span>, <span>Filter</span>, <span>Abstract/Elaborate</span>, and <span>Connect</span>. Through a within-subject study, we assessed participants’ abilities to utilise these techniques when faced with three distinct types of data-driven tasks; lookup, comparison, and Relation-seeking. Our research investigates the impact of these interaction techniques on the correctness, confidence, perceived difficulty, and cognitive load of N = 80 self-identified data scientists and N = 80 non-experts. We find that interaction technique significantly impacts answer correctness and participant confidence. Participants performed best across those interaction techniques that allow for information that is deemed least relevant to be concealed, which is reflected in lower intrinsic and extraneous cognitive load. Interestingly, participants’ expertise affected their confidence but not their accuracy. Our results provide insights useful for a more targeted and informed design and usage of interactive data visualisations.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1071581924001423/pdfft?md5=02cc8d46762448607a2127d822911854&pid=1-s2.0-S1071581924001423-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142123007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Keeping Fit & Staying Safe: A Systematic Review of Women's Use of Social Media for Fitness","authors":"Doireann Peelo Dennehy ,&nbsp;Stephanie Murphy ,&nbsp;Sarah Foley ,&nbsp;John McCarthy ,&nbsp;Kellie Morrissey","doi":"10.1016/j.ijhcs.2024.103361","DOIUrl":"10.1016/j.ijhcs.2024.103361","url":null,"abstract":"<div><p>Social media has transformed how users create, share, and consume health and fitness content. Research to date demonstrates that despite positive sharing opportunities, women are subject to misinformation, gendered harassment, and economic surveillance. To clarify the benefits and challenges facing women who interact with fitness content on social media, we conducted a qualitative systematic synthesis of 21 research papers. Thematic synthesis of the included papers describes how social media is used as a site to share information and experiences, how women engage with fitness content and how platforms are used in this engagement. We constructed four themes describing women's actions in engaging with fitness content online: producing, observing, interacting, and managing. In one of the main contributions of this paper, these themes are worked into a modes of engagement framework, for categorising and understanding the ways women use social media for fitness. This framework may be useful in further analysis of women's use of social media.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1071581924001447/pdfft?md5=625ee3e890becbb0f69316f39a17d3be&pid=1-s2.0-S1071581924001447-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142123008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Ergonomic assessment of mid-air interaction and device-assisted interactions under vibration environments based on task performance, muscle activity and user perceptions","authors":"Da Tao ,&nbsp;Waner Luo ,&nbsp;Yuzhuo Wu ,&nbsp;Kunhua Yang ,&nbsp;Hailiang Wang ,&nbsp;Xingda Qu","doi":"10.1016/j.ijhcs.2024.103364","DOIUrl":"10.1016/j.ijhcs.2024.103364","url":null,"abstract":"<div><p>Mid-air interaction has been increasingly introduced for human-computer interaction (HCI) tasks in vibration environments, but it has seldom been assessed from ergonomic aspects, especially in comparison with device-assisted interactions. This study aimed to provide a comprehensive ergonomic assessment of mid-air interaction and device-assisted interactions under vibration environments based on task performance, muscle activity in the upper limb and shoulder, and user perceptions. A within-subjects design was implemented in this study, where participants were required to perform basic pointing and dragging tasks with four interaction modes (i.e., one mid-air interaction and three device-assisted interactions) under static, low and high vibration environments, respectively. Both small and large target sizes were examined. Muscle activity was recorded with surface electromyography for five muscles from participants’ dominant arm. Results showed that mid-air interaction yielded longer task completion time, more errors, higher perceived workload, lower usability ratings, and larger muscle activities in the forearm, upper arm and shoulder compared with device-assisted interactions. There were significant interaction effects between vibration and interaction mode. Specifically, compared with device-assisted interactions, mid-air interaction was associated with greater susceptibility to the detrimental effects of vibration (poorer task performance and larger muscle activities). Target size significantly affected task performance, but the effects varied by tasks. Overall, our results suggest that mid-air interaction presents a higher ergonomic risk compared with device-assisted interactions, especially in vibration environments. These findings provide implications for better use, configuration and ergonomic assessment of interaction tools in vibration environments, and are useful in developing evidence-based interventions to control ergonomic risk in HCI tasks in vibration environments.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142088292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Object manipulation based on the head manipulation space in VR","authors":"Xiaolong Liu ,&nbsp;Lili Wang ,&nbsp;Wei Ke ,&nbsp;Sio-Kei Im","doi":"10.1016/j.ijhcs.2024.103346","DOIUrl":"10.1016/j.ijhcs.2024.103346","url":null,"abstract":"<div><p>Object manipulation is fundamental in virtual and augmented reality, where efficiency and accuracy are crucial. However, repetitive object manipulation tasks using the hands can lead to arm fatigue, and in some scenarios, hands may not be feasible for object manipulation. In this paper, we propose a novel approach for object manipulation based on head movement. Firstly, we introduce the concept of head manipulation space and conduct an experiment to collect head manipulation space data to determine the manipulable space. Then, we propose a new method for object manipulation based on head speed and inter-frame viewpoint quality to enhance the efficiency and accuracy of head manipulation. Finally, we design two user studies to evaluate the performance of our head-based object manipulation method. The results show that our method is feasible in terms of task completion efficiency and accuracy compared to state-of-the-art methods and greatly reduces user fatigue and motion sickness. Moreover, our method significantly improves usability and reduces task load. Our method lays a foundation for head-based object manipulation in virtual and augmented reality and provides a new manipulation method for scenarios where hands are not suitable for object manipulation.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142048238","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Effects of various in-vehicle human–machine interfaces on drivers’ takeover performance and gaze pattern in conditionally automated vehicles","authors":"Jinlei Shi ,&nbsp;Chunlei Chai ,&nbsp;Ruiyi Cai ,&nbsp;Haoran Wei ,&nbsp;Youcheng Zhou ,&nbsp;Hao Fan ,&nbsp;Wei Zhang ,&nbsp;Natasha Merat","doi":"10.1016/j.ijhcs.2024.103362","DOIUrl":"10.1016/j.ijhcs.2024.103362","url":null,"abstract":"<div><p>With the era of automated driving approaching, designing an effective and suitable human–machine interface (HMI) to present takeover requests (TORs) is critical to ensure driving safety. The present study conducted a simulated driving experiment to explore the effects of three HMIs (instrument panel, head-up display [HUD], and peripheral HMI) on takeover performance, simultaneously considering the TOR type (informative and generic TORs). Drivers’ eye movement data were also collected to investigate how drivers distribute their attention between the HMI and surrounding environment during the takeover process. The results showed that using the peripheral HMI to present TORs can shorten takeover time, and drivers rated this HMI as more useful and satisfactory than conventional HMIs (instrument panel and HUD). Eye movement analysis revealed that the peripheral HMI encourages drivers to spend more time gazing at the road ahead and less time gazing at the TOR information than the instrument panel and HUD, indicating a better gaze pattern for traffic safety. The HUD seemed to have a risk of capturing drivers’ attention, which resulted in an ‘attention tunnel,’ compared to the instrument panel. In addition, informative TORs were associated with better takeover performance and prompted drivers to spend less time gazing at rear-view mirrors than generic TORs. The findings of the present study can provide insights into the design and implementation of in-vehicle HMIs to improve the driving safety of automated vehicles.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142123006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}