{"title":"Designing an age-friendly conversational AI agent for mobile banking: the effects of voice modality and lip movement","authors":"Doha Kim , Hayeon Song","doi":"10.1016/j.ijhcs.2024.103262","DOIUrl":"10.1016/j.ijhcs.2024.103262","url":null,"abstract":"<div><p>Age factor is a significant barrier in adopting mobile banking mainly due to low competence in using the system and security concerns. Thus, this study presents a conversational artificial intelligence agent-based mobile banking app that is specially designed for seniors considering their needs and physical characteristics. Voice modality and lip-movement were identified as the important factors to improve seniors’ mobile banking service experience and the effect of them were empirically tested by conducting a controlled experiment with between-subject design. In total, 91 participants who were 55 years or older used the app to complete the given tasks of online banking. Results showed that those in the two voice modality conditions, compared to text agent condition, reported higher levels of trust, perceived ease of use, and social presence. The effect of lip movement of the agent also showed significant results in those three dependant variables. The result of mediation analysis revealed that agent's lip movement increased social presence and perceived ease of use, which further increased trust toward the agent. The results are meaningful especially because trust and perceived ease of use were listed as the main reason for not using online banking services among non-users. The implications of the study were discussed.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140275406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Congruent Indirect Touch vs. mouse pointing performance","authors":"François Bérard","doi":"10.1016/j.ijhcs.2024.103261","DOIUrl":"https://doi.org/10.1016/j.ijhcs.2024.103261","url":null,"abstract":"<div><p>We study Congruent Indirect Touch (CIT) interaction in a desktop context. CIT only differs from direct touch in that the motor and display spaces are separated: touch occurs on the horizontal desk; while users’ visual focus is on a vertical display where small pointers show the position of the fingers. We introduce an accurate fingertip tracking approach based on optical tracking and fingertip modeling as a sphere. This allows updating the pointer when the finger is hovering above the surface and implementing an efficient CIT interaction. This interaction was evaluated in a longitudinal user study. Six participants with no experience with CIT performed target acquisitions on eight different days. Throughput was measured with CIT and mouse. In the last session, two participants had similar throughput with both interactions; the four others were notably more efficient with CIT. Averaged across all participants, throughput improved by 14%. This study promotes the study of CIT as a potential efficient replacement for the mouse on the desktop.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1071581924000454/pdfft?md5=e7df789d23f88b2cc629d47457391ff5&pid=1-s2.0-S1071581924000454-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140190882","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Effects of first vs. third-person perspective and self- versus other-avatars on user movements in virtual reality","authors":"Andrea Stevenson Won , Shuo Zhou","doi":"10.1016/j.ijhcs.2024.103259","DOIUrl":"https://doi.org/10.1016/j.ijhcs.2024.103259","url":null,"abstract":"<div><p>Social science experiments in virtual reality (VR) frequently manipulate the perspective from which a user views an avatar and the identity of an avatar to change participant perceptions and attitudes. However, avatar embodiment may also influence physical behaviors—i.e., the way participants move—during the VR experience. For example, users may shift their position to align with avatars they see from a first-person perspective, a phenomenon known as the self-follower effect. We conducted a between-subjects, pre-registered study to understand how common techniques such as manipulating perspective and appearance might affect participant movements while in VR. We demonstrate that even when participants do not have agency over their avatars' movements, viewing avatar movements influences their own actions, whether these are viewed from the first <em>or</em> the third-person perspective. These phenomena hold potential as interventions to prompt participant movements in other contexts.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140551816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Using animation to develop a usability questionnaire: Scale development and psychological measurements","authors":"Wang Yuhui , Zhang Yiyang , Chen Yanying","doi":"10.1016/j.ijhcs.2024.103258","DOIUrl":"https://doi.org/10.1016/j.ijhcs.2024.103258","url":null,"abstract":"<div><p>This paper describes the development of a cartoon animation system usability scale (A-SUS) based on the established text-based SUS questionnaire. We propose a methodology and design a short graphic interchange format (.GIF) animation for each SUS item. Experimental evaluations confirm that the scale has satisfactory psychometric properties (e.g., structural validity, reliability factor structure, concurrent validity, and sensitivity). A second experiment is used to evaluate and compare the questionnaire experiences associated with the SUS, a pictorial SUS (P-SUS), and the developed A-SUS. The results indicate that A-SUS performs well in terms of recommendations, aesthetics, motivations, and completion time. Compared with the SUS and P-SUS, the animated version is more interesting, and the overall questionnaire experience is better.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140187944","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Asimina Vasalou , Andrea Gauthier , Ana Luisa Serta , Ceylan Beşevli , Sarah Turner , Racheal Payler , Rea Gill , Kevin McAreavey , George Loukas , Weiru Liu , Roser Beneito-Montagut
{"title":"In pursuit of thermal comfort: An exploration of smart heating in everyday life","authors":"Asimina Vasalou , Andrea Gauthier , Ana Luisa Serta , Ceylan Beşevli , Sarah Turner , Racheal Payler , Rea Gill , Kevin McAreavey , George Loukas , Weiru Liu , Roser Beneito-Montagut","doi":"10.1016/j.ijhcs.2024.103245","DOIUrl":"https://doi.org/10.1016/j.ijhcs.2024.103245","url":null,"abstract":"<div><p>Smart Home Heating Technologies (SHHT) have been designed to improve demand flexibility and energy conservation. SHHT rely on rational theories of energy use postulating that people will use less energy when the energy cost is higher. The inclusion of AI within SHHT is poised to optimise energy use in the future as the introduction of lower carbon energy sources place new demands on the grid. When SHHT is introduced in the home, however, they become situated in temporal heating practices that are shaped by an interplay of materiality, meanings, and competencies. We report findings from a mixed methods field study involving eleven households utilising an AI-enabled SHHT probe ‘Squid’. Taking a temporal focus throughout, our study contributes a new lens as to why households may not fully engage with SHHT's rational design, given that energy conversation is already embedded in their ongoing socio-material practices with heating. Focusing on the AI-human relation, we articulate the necessity for human agency where heating is involved, whilst also advancing an understanding of the new forms of hidden labour that households incur before they can engage with the AI. Crucially, our research informs the ongoing HCI concern over how humans understand AI, raising the question of who is responsible to assess the appropriateness of AI when the effects of human-AI performance remain opaque. Our findings contribute a new theoretical perspective into the intricate relationship between individuals and AI in the home and raise several new design implications for SHHT.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1071581924000296/pdfft?md5=bae262f54640f1575c94d73957cb355d&pid=1-s2.0-S1071581924000296-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140113476","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yan Ge , Hongyu Chen , Yuchen Wang , Weina Qu , Yubo Zhang , Yanfang Liu
{"title":"User perception of animation fluency: The effect of time duration in different phases of animated transitions during application usage","authors":"Yan Ge , Hongyu Chen , Yuchen Wang , Weina Qu , Yubo Zhang , Yanfang Liu","doi":"10.1016/j.ijhcs.2024.103257","DOIUrl":"https://doi.org/10.1016/j.ijhcs.2024.103257","url":null,"abstract":"<div><p>Animation fluency is an important factor of user experience in smartphone applications. The purpose of this study is to explore the effect of time duration in different sections of application usage on users’ perceived fluency. We manipulated the duration of different phases, including the click-response delay (CD), duration of animation (DA), and duration of loading completion (DL), in an open app task and an in-app page switching task. The participants evaluated the perceived fluency during their smartphone use. The results showed that the CD and DL had a significant effect on perceived fluency and that the CD, DA and DL showed significant interactions in some situations. These results could supply detailed parameters for smartphone design and could be used to build a model to guide manufacturers to provide a better user experience.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-03-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140031081","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adaptable automation for a more human-centered work design? Effects on human perception and behavior","authors":"Michèle Rieth , Linda Onnasch , Vera Hagemann","doi":"10.1016/j.ijhcs.2024.103246","DOIUrl":"10.1016/j.ijhcs.2024.103246","url":null,"abstract":"<div><p>This experiment systematically examines whether, in safety-critical environments such as Air Traffic Control, the negative effects of increasing automation associated with static automation concepts can be mitigated by adaptable automation. Adaptable automation is a form of flexible automation in which the human operator (rather than the system as in adaptive automation) can decide when and to what extent to delegate tasks. A special focus is on its effects on human perception in terms of perceived autonomy and competence, satisfaction, and human role perception. We conducted two online studies using the same dual-task paradigm. Study 1 was conducted with a novice sample <em>via</em> Prolific (<em>N</em> = 93) and study 2 with an expert sample of Air Traffic Controllers (<em>N</em> = 126). Participants were either supported by static information automation, static decision automation, or an adaptable solution that allowed them to switch between the two automation stages. The findings of both studies are similar. Results indicated that, even when humans rarely switched, adaptable automation could increase perceived autonomy, led to high satisfaction, and had positive effects on role perceptions without impairing performance or workload. Furthermore, satisfaction was found to correlate with performance. From a human-centered perspective, flexible concepts seem to be particularly suitable when automation increasingly takes over parts of a job task not only at the stage of information analysis but also at the stage of decision-making.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1071581924000302/pdfft?md5=6553125a3aa2809ef647112bf6893f89&pid=1-s2.0-S1071581924000302-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139926872","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tuomo Kujala , Hilkka Grahn , Jakke Mäkelä , Johanna Silvennoinen , Timo Tokkonen
{"title":"Effects of context-sensitive distraction warnings on drivers’ smartphone use and acceptance: A long-term naturalistic field study","authors":"Tuomo Kujala , Hilkka Grahn , Jakke Mäkelä , Johanna Silvennoinen , Timo Tokkonen","doi":"10.1016/j.ijhcs.2024.103247","DOIUrl":"10.1016/j.ijhcs.2024.103247","url":null,"abstract":"<div><p>Driver distraction by smartphone use is a major contributor in traffic accidents. Context-sensitive driver (in)attention monitoring and warning systems might mitigate the associated risks. However, few naturalistic studies are yet available on the effects of such systems. In this paper, utility of context-sensitivity in inattention monitoring was studied by a smartphone-based context-sensitive distraction warning system. The warnings were based on driver's phone use and the attentional demands of the upcoming traffic environment. The system's effects on 26 heavy smartphone users’ phone usage and acceptance were analyzed after a within-subject naturalistic study with 12 weeks of control (warnings off) and 12 weeks of interventions (warnings on). The system decreased odds that the drivers would touch their smartphones in reminder areas that were defined a priori as high demanding for attention. Against expectations, the system had no effect in urban road environments. The drivers reported that they had paid more attention to traffic because of the system and that the warnings were acceptable and useful, even if annoying. Similar systems’ safety effects should be further studied. No eye-tracking or driving performance measures were collected and thereby it is questionable if there was a true positive effect on participants’ attention. However, the findings suggest that (in)attention warning systems might benefit from adaptation of the warnings to the upcoming driving demands. The findings can be utilized for the development of proactive and context-sensitive (in)attention monitoring and distraction mitigation systems.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1071581924000314/pdfft?md5=105b7f4157cbc6072883520658eb15f7&pid=1-s2.0-S1071581924000314-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139926873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Quentin Sellier , Arthur Sluÿters , Jean Vanderdonckt , Ingrid Poncin
{"title":"Evaluating gesture user interfaces: Quantitative measures, qualitative scales, and method","authors":"Quentin Sellier , Arthur Sluÿters , Jean Vanderdonckt , Ingrid Poncin","doi":"10.1016/j.ijhcs.2024.103242","DOIUrl":"https://doi.org/10.1016/j.ijhcs.2024.103242","url":null,"abstract":"<div><p>Although many methods currently exist to evaluate a user interface, they have been mainly developed and applied for graphical and vocal user interfaces, leaving aside other modalities such as gesture interaction. As a consequence, the evaluation of the global quality of a gesture user interface most often resorts to these methods, which take little or no explicit and specific account of the gesture modality or which adapt existing methods in a way that jeopardizes their validity. To remedy this situation, this paper introduces, defines, and justifies a method for evaluating explicitly and specifically a gesture user interface based on a conceptual model that consists of: (1) six quantitative measures covering user and system aspects, such as gesture thinking time and recognition rate; (2) three new qualitative scales, <em>i.e.,</em> discoverability, learnability, and social acceptability, combined with seven scales in a gesture evaluation scheme, which is formally based on four measures, <em>i.e.,</em> subscale score, subscale importance, scale mean score and scale mean importance; (3) a debriefing interview to cross-analyze the results of the quantitative measures and qualitative scales. This method also includes the use of multiple sessions to take into account short and long-term memory, as well as discoverability, and integrates tests specific to each gesture, as well as concrete use cases. For validation and illustration purposes, this method is applied to a gesture user interface serving as a case study. The results are then analyzed, starting with classic methods and gradually adding the particularities of our method to highlight its added value. Based on this experiment, we suggest some implications for evaluating gesture interfaces and for incorporating these scales into UEQ+, a modular user interface evaluation method.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-02-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139738400","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Augmenting the feel of real objects: An analysis of haptic augmented reality","authors":"Arpit Bhatia , Kasper Hornbæk , Hasti Seifi","doi":"10.1016/j.ijhcs.2024.103244","DOIUrl":"https://doi.org/10.1016/j.ijhcs.2024.103244","url":null,"abstract":"<div><p>Advances in haptic technologies can alter how real objects feel to our touch and create the experience of haptic augmented reality (AR). However, the definition, use cases, and value to end users of such haptic AR remain unclear. Existing work is concerned with technological implementation and lacks a user-centered perspective. To address these limitations, we analyze haptic AR systems in the literature to understand what constitutes haptic AR, why we would want to alter our sense of touch, and how haptic AR interactions take place. To demonstrate the value of studying haptic AR in the context of real-world tasks and user impressions of the concept itself, we also conducted a small exploratory study with five prototypical applications of different haptic AR systems. Our analysis highlights unexplored areas for haptics and HCI researchers and the need to conduct user evaluations of the overall concept rather than just point examples.</p></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":null,"pages":null},"PeriodicalIF":5.4,"publicationDate":"2024-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1071581924000284/pdfft?md5=59015edde25d1102fd1f3fbb64b7c250&pid=1-s2.0-S1071581924000284-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139718984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}