Multimodal Technol. Interact.最新文献_第9页

Virtual Reality in Health Science Education: Professors' Perceptions 健康科学教育中的虚拟现实:教授的看法

Multimodal Technol. Interact. Pub Date : 2022-12-14 DOI: 10.3390/mti6120110

Álvaro Antón‐Sancho, Pablo Fernández‐Arias, Diego Vergara

{"title":"Virtual Reality in Health Science Education: Professors' Perceptions","authors":"Álvaro Antón‐Sancho, Pablo Fernández‐Arias, Diego Vergara","doi":"10.3390/mti6120110","DOIUrl":"https://doi.org/10.3390/mti6120110","url":null,"abstract":"Virtual reality (VR) is a simulated experience in a three-dimensional (3D) computer-simulated world. Recent advances in technology position VR as a multipurpose technology in the healthcare sector and as a critical component in achieving Health 4.0. In this article, descriptive and correlationally quantitative research is carried out on the assessments made by Latin American health sciences university professors on the didactic use of virtual reality technologies. The main objective was to analyze the differences in the perceptions expressed by the public or private tenure of the universities where the professors teach. In addition, gender and age gaps were identified in the assessments obtained from each of the types of universities. The results reveal that Latin American health science professors at private universities have a higher selfconcept of their digital skills for the use of virtual reality in the lectures. This greater selfconcept also leads to a reduction in the gender and age gaps in the participating private universities with respect to the public counterparts. It is advisable to increase both faculty training in the didactic use of virtual reality and funding for its use, mainly in public universities.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115997394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

patchIT: A Multipurpose Patch Creation Tool for Image Processing Applications 一个用于图像处理应用程序的多用途补丁创建工具

Multimodal Technol. Interact. Pub Date : 2022-12-14 DOI: 10.3390/mti6120111

A. Kesidis, Vassilios Krassanakis, Loukas-Moysis Misthos, N. Merlemis

{"title":"patchIT: A Multipurpose Patch Creation Tool for Image Processing Applications","authors":"A. Kesidis, Vassilios Krassanakis, Loukas-Moysis Misthos, N. Merlemis","doi":"10.3390/mti6120111","DOIUrl":"https://doi.org/10.3390/mti6120111","url":null,"abstract":"Patch-based approaches in image processing are often preferable to working with the entire image. They provide an alternative representation of the image as a set of partial local sub-images (patches) which is a vital preprocessing step in many image processing applications. In this paper, a new software tool called patchIT is presented, providing an integrated framework suitable for the systematic and automatized extraction of patches from images based on user-defined geometrical and spatial criteria. Patches can be extracted in both a sliding and random manner and can be exported either as images, MATLAB .mat files, or raw text files. The proposed tool offers further functionality, including masking operations that act as spatial filters, identifying candidate patch areas, as well as geometric transformations by applying patch value indexing. It also efficiently handles issues that arise in large-scale patch processing scenarios in terms of memory and time requirements. In addition, a use case in cartographic research is presented that utilizes patchIT for map evaluation purposes based on a visual heterogeneity indicator. The tool supports all common image file formats and efficiently processes bitonal, grayscale, color, and multispectral images. PatchIT is freely available to the scientific community under the third version of GNU General Public License (GPL v3) on the GitHub platform.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117252766","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Understanding Operator Influence in Automated Urban Shuttle Buses and Recommendations for Future Development 了解运营商对城市穿梭巴士自动化的影响及未来发展建议

Multimodal Technol. Interact. Pub Date : 2022-12-13 DOI: 10.3390/mti6120109

Martina Schuß, Alice Rollwagen, A. Riener

{"title":"Understanding Operator Influence in Automated Urban Shuttle Buses and Recommendations for Future Development","authors":"Martina Schuß, Alice Rollwagen, A. Riener","doi":"10.3390/mti6120109","DOIUrl":"https://doi.org/10.3390/mti6120109","url":null,"abstract":"The automation of our vehicles is an all-present topic with great benefits for society, particularly in the area of public transport and pilot projects of automated shuttle buses are already underway. However, they do not show the full potential of using them as a supplement to public transport, since single-occupancy registration of the vehicles usually allows only slow speeds and also requires a substitute driver on board. In our study, we aim to (1) examine the status quo of its user acceptance and (2) identify the roles of the operators and their tasks in automated urban shuttle buses. We conducted a mixed-method study including in-depth interviews, questionnaires, and in-the-field observations visiting pilot projects of the two most widespread pilot projects on German streets. Our results uncover the multiple roles and tasks the human operators currently assume. Furthermore, we developed design approaches for a digital companion substituting the operator in a long run and evaluated these concepts. A remote operator or a hologram were preferred solutions and we propose further design requirements for such companions. This work helps to understand the individual roles that operators currently occupy and provides a good basis for concepts of technologies that will perform these tasks in the future.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133920760","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Usability Tests for Texture Comparison in an Electroadhesion-Based Haptic Device 基于电粘合的触觉设备中纹理比较的可用性测试

Multimodal Technol. Interact. Pub Date : 2022-12-08 DOI: 10.2139/ssrn.4115297

Afonso Castiço, P. Cardoso

引用次数: 2

User Authentication Recognition Process Using Long Short-Term Memory Model 基于长短期记忆模型的用户身份识别过程

Multimodal Technol. Interact. Pub Date : 2022-11-30 DOI: 10.3390/mti6120107

Bengie L. Ortiz, Vibhuti Gupta, J. Chong, Kwanghee Jung, Tim Dallas

{"title":"User Authentication Recognition Process Using Long Short-Term Memory Model","authors":"Bengie L. Ortiz, Vibhuti Gupta, J. Chong, Kwanghee Jung, Tim Dallas","doi":"10.3390/mti6120107","DOIUrl":"https://doi.org/10.3390/mti6120107","url":null,"abstract":"User authentication (UA) is the process by which biometric techniques are used by a person to gain access to a physical or virtual site. UA has been implemented in various applications such as financial transactions, data privacy, and access control. Various techniques, such as facial and fingerprint recognition, have been proposed for healthcare monitoring to address biometric recognition problems. Photoplethysmography (PPG) technology is an optical sensing technique which collects volumetric blood change data from the subject’s skin near the fingertips, earlobes, or forehead. PPG signals can be readily acquired from devices such as smartphones, smartwatches, or web cameras. Classical machine learning techniques, such as decision trees, support vector machine (SVM), and k-nearest neighbor (kNN), have been proposed for PPG identification. We developed a UA classification method for smart devices using long short-term memory (LSTM). Specifically, our UA classifier algorithm uses raw signals so as not to lose the specific characteristics of the PPG signal coming from each user’s specific behavior. In the UA context, false positive and false negative rates are crucial. We recruited thirty healthy subjects and used a smartphone to take PPG data. Experimental results show that our Bi-LSTM-based UA algorithm based on the feature-based machine learning and raw data-based deep learning approaches provides 95.0% and 96.7% accuracy, respectively.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"86 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115534974","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Inhibitors and Enablers to Explainable AI Success: A Systematic Examination of Explanation Complexity and Individual Characteristics

Multimodal Technol. Interact. Pub Date : 2022-11-28 DOI: 10.3390/mti6120106

Carolin Wienrich, Astrid Carolus, David Roth-Isigkeit, A. Hotho

{"title":"Inhibitors and Enablers to Explainable AI Success: A Systematic Examination of Explanation Complexity and Individual Characteristics","authors":"Carolin Wienrich, Astrid Carolus, David Roth-Isigkeit, A. Hotho","doi":"10.3390/mti6120106","DOIUrl":"https://doi.org/10.3390/mti6120106","url":null,"abstract":"With the increasing adaptability and complexity of advisory artificial intelligence (AI)-based agents, the topics of explainable AI and human-centered AI are moving close together. Variations in the explanation itself have been widely studied, with some contradictory results. These could be due to users’ individual differences, which have rarely been systematically studied regarding their inhibiting or enabling effect on the fulfillment of explanation objectives (such as trust, understanding, or workload). This paper aims to shed light on the significance of human dimensions (gender, age, trust disposition, need for cognition, affinity for technology, self-efficacy, attitudes, and mind attribution) as well as their interplay with different explanation modes (no, simple, or complex explanation). Participants played the game Deal or No Deal while interacting with an AI-based agent. The agent gave advice to the participants on whether they should accept or reject the deals offered to them. As expected, giving an explanation had a positive influence on the explanation objectives. However, the users’ individual characteristics particularly reinforced the fulfillment of the objectives. The strongest predictor of objective fulfillment was the degree of attribution of human characteristics. The more human characteristics were attributed, the more trust was placed in the agent, advice was more likely to be accepted and understood, and important needs were satisfied during the interaction. Thus, the current work contributes to a better understanding of the design of explanations of an AI-based agent system that takes into account individual characteristics and meets the demand for both explainable and human-centered agent systems.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130983859","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Narrative Visualization with Augmented Reality 叙事可视化与增强现实

Multimodal Technol. Interact. Pub Date : 2022-11-26 DOI: 10.3390/mti6120105

Ana Beatriz Marques, V. Branco, Rui Costa

{"title":"Narrative Visualization with Augmented Reality","authors":"Ana Beatriz Marques, V. Branco, Rui Costa","doi":"10.3390/mti6120105","DOIUrl":"https://doi.org/10.3390/mti6120105","url":null,"abstract":"The following study addresses, from a design perspective, narrative visualization using augmented reality (AR) in real physical spaces, and specifically in spaces with no semantic relation with the represented data. We intend to identify the aspects augmented reality adds, as narrative possibilities, to data visualization. Particularly, we seek to identify the aspects augmented reality introduces regarding the three dimensions of narrative visualization—view, focus and sequence. For this purpose, we adopted a comparative analysis of a set of fifty case studies, specifically, narrative visualizations using augmented reality from a journalistic scope, where narrative is a key feature. Despite the strong explanatory character that characterizes the set of analyzed cases, which sometimes limits the user’s agency, there is a strong interactive factor. It was found that augmented reality can expand the narrative possibilities in the three dimensions mentioned—view, focus and sequence—but especially regarding visual strategies where simulation plays an essential role. As a visual strategy, simulation can provide the context for communication or be the object of communication itself, as a replica.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133100492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Design and Implementation of a Personalizable Alternative Mouse and Keyboard Interface for Individuals with Limited Upper Limb Mobility 为上肢活动受限的个人设计和实现可个性化的鼠标和键盘界面

Multimodal Technol. Interact. Pub Date : 2022-11-24 DOI: 10.3390/mti6120104

D. Andreas, Hannah Six, Adna Bliek, P. Beckerle

{"title":"Design and Implementation of a Personalizable Alternative Mouse and Keyboard Interface for Individuals with Limited Upper Limb Mobility","authors":"D. Andreas, Hannah Six, Adna Bliek, P. Beckerle","doi":"10.3390/mti6120104","DOIUrl":"https://doi.org/10.3390/mti6120104","url":null,"abstract":"People with neuromuscular diseases often experience limited upper limb mobility, which makes the handling of standard computer mice and keyboards difficult. Due to the importance of computers in private and professional life, this work aims at implementing an alternative mouse and keyboard interface that will allow for their efficient use by people with a neuromuscular disease. Due to the strongly differing symptoms of these diseases, personalization on the hardware and software levels is the focus of our work. The presented mouse alternative is based on a spectacle frame with an integrated motion sensor for head tracking, which enables the control of the mouse cursor position; the keyboard alternative consists of ten keys, which are used to generate word suggestions for the user input. The interface was tested in a user study involving three participants without disabilities, which showed the general functionality of the system and potential room for improvement. With an average throughput of 1.56 bits per second achieved by the alternative mouse and typing speeds of 8.44 words per minute obtained using the alternative keyboard, the proposed interface could be a promising input device for people with limited upper limb mobility.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126638054","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Identifying and Addressing Needs of Heterogeneous User Groups - A Case Study from the Banking Sector 识别和处理不同用户群体的需求——以银行业为例

Multimodal Technol. Interact. Pub Date : 2022-11-23 DOI: 10.3390/mti6120103

K. Pollmann, Doris Janssen, Nora Fronemann, Milena Velić, Philippe Bouillé, Béatrice Foucault, Nathalie Bégoc Bécam

引用次数: 0

Text Spotting towards Perceptually Aliased Urban Place Recognition 面向感知混叠城市地点识别的文本定位

Multimodal Technol. Interact. Pub Date : 2022-11-18 DOI: 10.3390/mti6110102

Dulmini Hettiarachchi, Ye Tian, Han Yu, S. Kamijo

{"title":"Text Spotting towards Perceptually Aliased Urban Place Recognition","authors":"Dulmini Hettiarachchi, Ye Tian, Han Yu, S. Kamijo","doi":"10.3390/mti6110102","DOIUrl":"https://doi.org/10.3390/mti6110102","url":null,"abstract":"Recognizing places of interest (POIs) can be challenging for humans, especially in foreign environments. In this study, we leverage smartphone sensors (i.e., camera, GPS) and deep learning algorithms to propose an intelligent solution to recognize POIs in an urban environment. Recent studies have approached landmark recognition as an image retrieval problem. However, visual similarity alone is not robust against challenging conditions such as extreme appearance variance and perceptual aliasing in urban environments. To this end, we propose to fuse visual, textual, and positioning information. Our contributions are as follows. Firstly, we propose VPR through text reading pipeline (VPRText) that uses off-the-shelf text spotting algorithms for word spotting followed by layout analysis and text similarity search modules. Secondly, we propose a hierarchical architecture that combines VPRText and image retrieval. Thirdly, we perform a comprehensive empirical study on the applicability of state-of-the-art text spotting methods for the VPR task. Additionally, we introduce a challenging purpose-built urban dataset for VPR evaluation. The proposed VPR architecture achieves a superior performance overall, especially in challenging conditions (i.e., perceptually aliased and illuminated environments).","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127959423","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0