Journal on Multimodal User Interfaces最新文献

Human or robot? Exploring different avatar appearances to increase perceived security in shared automated vehicles 人类还是机器人？探索不同的化身外观，提高共享自动驾驶汽车的安全感

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2024-08-30 DOI: 10.1007/s12193-024-00436-x

Martina Schuß, Luca Pizzoni, Andreas Riener

{"title":"Human or robot? Exploring different avatar appearances to increase perceived security in shared automated vehicles","authors":"Martina Schuß, Luca Pizzoni, Andreas Riener","doi":"10.1007/s12193-024-00436-x","DOIUrl":"https://doi.org/10.1007/s12193-024-00436-x","url":null,"abstract":"Shared Automated Vehicles (SAVs) promise to make automated mobility accessible to a wide range of people while reducing air pollution and improving traffic flow. In the future, these vehicles will operate with no human driver on board, which poses several challenges that might differ depending on the cultural context and make one-fits-all solutions demanding. A promising substitute for the driver could be Digital Companions (DCs), i.e. conversational agents presented on a screen inside the vehicles. We conducted interviews with Colombian participants and workshops with German and Korean participants and derived two design concepts of DCs as an alternative for the human driver on SAVs: a human-like and a robot-like. We compared these two concepts to a baseline without companion using a scenario-based online questionnaire with participants from Colombia (N = 57), Germany (N = 50), and Korea (N = 29) measuring anxiety, security, trust, risk, control, threat, and user experience. In comparison with the baseline, both DCs are statistically significantly perceived as more positively. While we found a preference for the human-like DC among all participants, this preference is higher among Colombians while Koreans show the highest openness towards the robot-like DC.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"11 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142205895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

AirWhisper: enhancing virtual reality experience via visual-airflow multimodal feedback AirWhisper：通过视觉-气流多模态反馈增强虚拟现实体验

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2024-08-20 DOI: 10.1007/s12193-024-00438-9

Fangtao Zhao, Ziming Li, Yiming Luo, Yue Li, Hai-Ning Liang

{"title":"AirWhisper: enhancing virtual reality experience via visual-airflow multimodal feedback","authors":"Fangtao Zhao, Ziming Li, Yiming Luo, Yue Li, Hai-Ning Liang","doi":"10.1007/s12193-024-00438-9","DOIUrl":"https://doi.org/10.1007/s12193-024-00438-9","url":null,"abstract":"Virtual reality (VR) technology has been increasingly focusing on incorporating multimodal outputs to enhance the sense of immersion and realism. In this work, we developed AirWhisper, a modular wearable device that provides dynamic airflow feedback to enhance VR experiences. AirWhisper simulates wind from multiple directions around the user’s head via four micro fans and 3D-printed attachments. We applied a Just Noticeable Difference study to support the design of the control system and explore the user’s perception of the characteristics of the airflow in different directions. Through multimodal comparison experiments, we find that vision-airflow multimodality output can improve the user’s VR experience from several perspectives. Finally, we designed scenarios with different airflow change patterns and different levels of interaction to test AirWhisper’s performance in various contexts and explore the differences in users’ perception of airflow under different virtual environment conditions. Our work shows the importance of developing human-centered multimodal feedback adaptive learning models that can make real-time dynamic changes based on the user’s perceptual characteristics and environmental features.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"26 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142205945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Truck drivers’ views on the road safety benefits of advanced driver assistance systems and Intelligent Transport Systems in Tanzania 坦桑尼亚卡车司机对先进驾驶辅助系统和智能交通系统的道路安全效益的看法

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2024-08-03 DOI: 10.1007/s12193-024-00437-w

Marwa Chacha, Prosper Nyaki, Ariane Cuenen, Ansar Yasar, Geert Wets

{"title":"Truck drivers’ views on the road safety benefits of advanced driver assistance systems and Intelligent Transport Systems in Tanzania","authors":"Marwa Chacha, Prosper Nyaki, Ariane Cuenen, Ansar Yasar, Geert Wets","doi":"10.1007/s12193-024-00437-w","DOIUrl":"https://doi.org/10.1007/s12193-024-00437-w","url":null,"abstract":"The transportation of goods by road is crucial in Tanzania’s Central and North-South Corridors. However, challenges such as truck congestion and road accidents are affecting the efficiency of these routes. Road crashes are prevalent in low- and middle-income countries, with Africa experiencing an exceptionally high rate. This study examines the opinions of Tanzanian truck drivers on the effectiveness of Advanced Driver Assistance Systems in reducing road safety risks. A discriminant analysis was conducted to assess the awareness and use of these systems among different driver experienced groups. The results highlight the importance of improving infrastructure, ensuring vehicle safety standards, providing comprehensive driver training, and integrating innovative Intelligent Transport Systems to address road safety issues. In conclusion, the study provides valuable insights for policymakers and stakeholders to strengthen road safety measures in Tanzania, facilitating smoother road freight transport operations and promoting economic growth.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"4 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141942192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

In-vehicle nudging for increased Adaptive Cruise Control use: a field study 通过车内提示提高自适应巡航控制系统的使用率：一项实地研究

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2024-06-26 DOI: 10.1007/s12193-024-00434-z

Pär Gustavsson, Mikael Ljung Aust

{"title":"In-vehicle nudging for increased Adaptive Cruise Control use: a field study","authors":"Pär Gustavsson, Mikael Ljung Aust","doi":"10.1007/s12193-024-00434-z","DOIUrl":"https://doi.org/10.1007/s12193-024-00434-z","url":null,"abstract":"Close following to lead vehicles is associated with increased risk of rear-end crashes in road traffic. One way to reduce instances of close following is through increased use of the Advanced Driver Assistance System (ADAS) Adaptive Cruise Control (ACC), which is designed to adjust vehicle speed to maintain a safe time headway. Since the activation of ACC is driver-initiated, there is a need to influence the propensity of drivers to use the function. This research aimed to explore whether in-vehicle nudging interventions could be effective for this purpose. A field trial was conducted to consecutively assess the effects of two nudges on drivers’ utilization of ACC, compared to baseline usage. Exposing the participants (n = 49) to the first ambient design nudge resulted in a 46% increase in ACC usage on average. Following the introduction of the second nudge (a competitive leaderboard nudge), the average increase among participants (n = 48) during the complete treatment period reached 61%. The changes in ACC utilization varied between individual drivers, highlighting the need to monitor behavioral outcomes of nudges and adapt them when needed. In conclusion, this research shows that utilizing in-vehicle nudging is a promising approach to increase the use of vehicle functions contributing to improved traffic safety.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"37 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141500992","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Prediction of pedestrian crossing behaviour at unsignalized intersections using machine learning algorithms: analysis and comparison 利用机器学习算法预测无信号灯交叉路口的行人过马路行为：分析与比较

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2024-05-28 DOI: 10.1007/s12193-024-00433-0

Dungar Singh, Pritikana Das, Indrajit Ghosh

{"title":"Prediction of pedestrian crossing behaviour at unsignalized intersections using machine learning algorithms: analysis and comparison","authors":"Dungar Singh, Pritikana Das, Indrajit Ghosh","doi":"10.1007/s12193-024-00433-0","DOIUrl":"https://doi.org/10.1007/s12193-024-00433-0","url":null,"abstract":"The primary safety hazard at unsignalized intersections, particularly in urban areas, is pedestrian-vehicle collisions. Due to its complexity and inattention, pedestrian crossing behaviour has a significant impact on their safety. This study introduces a novel framework to enhance pedestrian safety at unsignalized intersections by developing a predictive model of pedestrian crossing behaviour using machine learning algorithms. While accounting for crossing behaviour as the dependent variable and other independent variables, the analysis prioritises accuracy and internal validity. Important feature scores for the different algorithms were assessed. The model results revealed that the arrival first of a pedestrian or vehicle, pedestrian delay, vehicle speed, pedestrian speed, age, gender, traffic hour, and vehicle category are highly influencing variables for analysing pedestrian behaviour while crossing at unsignalized intersections. This study found that the prediction of pedestrian behaviour based on random forest, extreme gradient boosting and binary logit model achieved 81.72%, 77.19% and 74.95%, respectively. Algorithms, including k-nearest neighbours, artificial neural networks, and support vector machines, have varying classification performance at every step. The findings of this study may be used to support infrastructure-to-vehicle interactions, enabling vehicles to successfully negotiate rolling pedestrian behaviour and improving pedestrian safety.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"63 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141167667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Towards the development of an automated robotic storyteller: comparing approaches for emotional story annotation for non-verbal expression via body language 开发自动机器人讲故事器：比较通过肢体语言进行非语言表达的情感故事注释方法

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2024-04-04 DOI: 10.1007/s12193-024-00429-w

Sophia C. Steinhaeusser, Albin Zehe, Peggy Schnetter, Andreas Hotho, Birgit Lugrin

{"title":"Towards the development of an automated robotic storyteller: comparing approaches for emotional story annotation for non-verbal expression via body language","authors":"Sophia C. Steinhaeusser, Albin Zehe, Peggy Schnetter, Andreas Hotho, Birgit Lugrin","doi":"10.1007/s12193-024-00429-w","DOIUrl":"https://doi.org/10.1007/s12193-024-00429-w","url":null,"abstract":"Storytelling is a long-established tradition and listening to stories is still a popular leisure activity. Caused by technization, storytelling media expands, e.g., to social robots acting as multi-modal storytellers, using different multimodal behaviours such as facial expressions or body postures. With the overarching goal to automate robotic storytelling, we have been annotating stories with emotion labels which the robot can use to automatically adapt its behavior. With it, three different approaches are compared in two studies in this paper: 1) manual labels by human annotators (MA), 2) software-based word-sensitive annotation using the Linguistic Inquiry and Word Count program (LIWC), and 3) a machine learning based approach (ML). In an online study showing videos of a storytelling robot, the annotations were validated, with LIWC and MA achieving the best, and ML the worst results. In a laboratory user study, the three versions of the story were compared regarding transportation and cognitive absorption, revealing no significant differences but a positive trend towards MA. On this empirical basis, the Automated Robotic Storyteller was implemented using manual annotations. Future iterations should include other robots and modalities, fewer emotion labels and their probabilities.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"34 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140588171","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Review of substitutive assistive tools and technologies for people with visual impairments: recent advancements and prospects 视障人士替代性辅助工具和技术回顾：最新进展与前景

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-12-19 DOI: 10.1007/s12193-023-00427-4

Zahra J. Muhsin, Rami Qahwaji, Faruque Ghanchi, Majid Al-Taee

{"title":"Review of substitutive assistive tools and technologies for people with visual impairments: recent advancements and prospects","authors":"Zahra J. Muhsin, Rami Qahwaji, Faruque Ghanchi, Majid Al-Taee","doi":"10.1007/s12193-023-00427-4","DOIUrl":"https://doi.org/10.1007/s12193-023-00427-4","url":null,"abstract":"The development of many tools and technologies for people with visual impairment has become a major priority in the field of assistive technology research. However, many of these technology advancements have limitations in terms of the human aspects of the user experience (e.g., usability, learnability, and time to user adaptation) as well as difficulties in translating research prototypes into production. Also, there was no clear distinction between the assistive aids of adults and children, as well as between “partial impairment” and “total blindness”. As a result of these limitations, the produced aids have not gained much popularity and the intended users are still hesitant to utilise them. This paper presents a comprehensive review of substitutive interventions that aid in adapting to vision loss, centred on laboratory research studies to assess user-system interaction and system validation. Depending on the primary cueing feedback signal offered to the user, these technology aids are categorized as visual, haptics, or auditory-based aids. The context of use, cueing feedback signals, and participation of visually impaired people in the evaluation are all considered while discussing these aids. Based on the findings, a set of recommendations is suggested to assist the scientific community in addressing persisting challenges and restrictions faced by both the totally blind and partially sighted people.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"234 1 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2023-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138742323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Augmented reality and deep learning based system for assisting assembly process 基于增强现实和深度学习的装配辅助系统

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-12-14 DOI: 10.1007/s12193-023-00428-3

{"title":"Augmented reality and deep learning based system for assisting assembly process","authors":"","doi":"10.1007/s12193-023-00428-3","DOIUrl":"https://doi.org/10.1007/s12193-023-00428-3","url":null,"abstract":"<h3>Abstract</h3> In Industry 4.0, manufacturing entails a rapid change in customer demands which leads to mass customization. The variation in customer requirements leads to small batch sizes and several process variations. Assembly task is one of most important steps in any manufacturing process. A factory floor worker often needs a guidance system due to variations in product or process, to assist them in assembly task. Existing Augmented Reality (AR) based systems use markers for each assembly component for detection which is time consuming and laborious. This paper proposed utilizing state-of-the-art deep learning based object detection technique and employed a regression based mapping technique to obtain the 3D locations of assembly components. Automatic detection of machine parts was followed by a multimodal interface involving both eye gaze and hand tracking to guide the manual assembly process. We proposed eye cursor to guide the user through the task and utilized fingertip distances along with object sizes to detect any error committed during the task. We analyzed the proposed mapping method and found that the mean mapping error was 1.842 cm. We also investigated the effectiveness of the proposed multimodal user interface by conducting two user studies. The first study indicated that the current interface design with eye cursor enabled participants to perform the task significantly faster compared to the interface without eye cursor. The shop floor workers during the second user study reported that the proposed guidance system was comprehendible and easy to use to complete the assembly task. Results showed that the proposed guidance system enabled 11 end users to finish the assembly of one pneumatic cylinder within 55 s with average TLX score less than 25 in a scale of 100 and Cronbach alpha score of 0.8 indicating convergence of learning experience.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":"9 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2023-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138684924","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Modelling the “transactive memory system” in multimodal multiparty interactions 多模态多方交互中的“交互记忆系统”建模

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-11-11 DOI: 10.1007/s12193-023-00426-5

Beatrice Biancardi, Maurizio Mancini, Brian Ravenet, Giovanna Varni

引用次数: 0

Model-based sonification based on the impulse pattern formulation 基于脉冲模式公式的模型超声

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-11-06 DOI: 10.1007/s12193-023-00423-8

Simon Linke, Rolf Bader, Robert Mores

引用次数: 0