Multimodal Technologies and Interaction最新文献_第3页

Design and Evaluation of a Memory-Recalling Virtual Reality Application for Elderly Users 面向老年用户的记忆恢复虚拟现实应用的设计与评估

Multimodal Technologies and Interaction Pub Date : 2024-03-21 DOI: 10.3390/mti8030024

Zoe Anastasiadou, Eleni Dimitriadou, Andreas Lanitis

引用次数: 0

Show-and-Tell: An Interface for Delivering Rich Feedback upon Creative Media Artefacts 展示与讲述：为创意媒体作品提供丰富反馈的界面

Multimodal Technologies and Interaction Pub Date : 2024-03-14 DOI: 10.3390/mti8030023

Colin Dodds, Ahmed Kharrufa

{"title":"Show-and-Tell: An Interface for Delivering Rich Feedback upon Creative Media Artefacts","authors":"Colin Dodds, Ahmed Kharrufa","doi":"10.3390/mti8030023","DOIUrl":"https://doi.org/10.3390/mti8030023","url":null,"abstract":"In this paper, we explore an approach to feedback which could allow those learning creative digital media practices in remote and asynchronous environments to receive rich, multi-modal, and interactive feedback upon their creative artefacts. We propose the show-and-tell feedback interface which couples graphical user interface changes (the show) to a text-based explanations (the tell). We describe the rationale behind the design and offer a tentative set of design criteria. We report the implementation and deployment into a real-world educational setting using a prototype interface developed to allow either traditional text-only feedback or our proposed show-and tell feedback across four sessions. The prototype was used to provide formative feedback upon music students’ coursework resulting in a total of 103 pieces of feedback. Thematic analysis was used to analyse the data obtained through interviews and focus groups with both educators and students (i.e., feedback givers and receivers). Recipients considered show-and-tell feedback to possess greater clarity and detail in comparison with the single modality text-only feedback they are used to receiving. We also report interesting emergent issues around control and artistic vision, and we discuss how these issues could be mitigated in future iterations of the interface.","PeriodicalId":508555,"journal":{"name":"Multimodal Technologies and Interaction","volume":"31 S1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140243619","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Enhancing Calculus Learning through Interactive VR and AR Technologies: A Study on Immersive Educational Tools 通过交互式虚拟现实和增强现实技术加强微积分学习：沉浸式教育工具研究

Multimodal Technologies and Interaction Pub Date : 2024-03-01 DOI: 10.3390/mti8030019

Logan Pinter, Mohammad Faridul Haque Siddiqui

引用次数: 0

Keep the Human in the Loop: Arguments for Human Assistance in the Synthesis of Simulation Data for Robot Training 让人类参与其中：机器人训练模拟数据合成中的人工辅助论证

Multimodal Technologies and Interaction Pub Date : 2024-03-01 DOI: 10.3390/mti8030018

C. Liebers, Pranav Megarajan, Jonas Auda, Tim Claudius Stratmann, Max Pfingsthorn, Uwe Gruenefeld, Stefan Schneegass

{"title":"Keep the Human in the Loop: Arguments for Human Assistance in the Synthesis of Simulation Data for Robot Training","authors":"C. Liebers, Pranav Megarajan, Jonas Auda, Tim Claudius Stratmann, Max Pfingsthorn, Uwe Gruenefeld, Stefan Schneegass","doi":"10.3390/mti8030018","DOIUrl":"https://doi.org/10.3390/mti8030018","url":null,"abstract":"Robot training often takes place in simulated environments, particularly with reinforcement learning. Therefore, multiple training environments are generated using domain randomization to ensure transferability to real-world applications and compensate for unknown real-world states. We propose improving domain randomization by involving human application experts in various stages of the training process. Experts can provide valuable judgments on simulation realism, identify missing properties, and verify robot execution. Our human-in-the-loop workflow describes how they can enhance the process in five stages: validating and improving real-world scans, correcting virtual representations, specifying application-specific object properties, verifying and influencing simulation environment generation, and verifying robot training. We outline examples and highlight research opportunities. Furthermore, we present a case study in which we implemented different prototypes, demonstrating the potential of human experts in the given stages. Our early insights indicate that human input can benefit robot training at different stages.","PeriodicalId":508555,"journal":{"name":"Multimodal Technologies and Interaction","volume":" November","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140092720","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Trust Development and Explainability: A Longitudinal Study with a Personalized Assistive System 信任发展与可解释性：个性化辅助系统纵向研究

Multimodal Technologies and Interaction Pub Date : 2024-03-01 DOI: 10.3390/mti8030020

Setareh Zafari, Jesse de Pagter, Guglielmo Papagni, Alischa Rosenstein, Michael Filzmoser, Sabine T. Koeszegi

引用次数: 0

Accessible Metaverse: A Theoretical Framework for Accessibility and Inclusion in the Metaverse 无障碍元网：元宇宙中的无障碍和包容性理论框架

Multimodal Technologies and Interaction Pub Date : 2024-03-01 DOI: 10.3390/mti8030021

Achra Othman, Khansa Chemnad, A. Hassanien, A. Tlili, Christina Yan Zhang, Dena Al-Thani, F. Altınay, Hajer Chalghoumi, Hend S. Al-Khalifa, Maisa Obeid, Mohamed Jemni, Tawfik Al-Hadhrami, Z. Altınay

{"title":"Accessible Metaverse: A Theoretical Framework for Accessibility and Inclusion in the Metaverse","authors":"Achra Othman, Khansa Chemnad, A. Hassanien, A. Tlili, Christina Yan Zhang, Dena Al-Thani, F. Altınay, Hajer Chalghoumi, Hend S. Al-Khalifa, Maisa Obeid, Mohamed Jemni, Tawfik Al-Hadhrami, Z. Altınay","doi":"10.3390/mti8030021","DOIUrl":"https://doi.org/10.3390/mti8030021","url":null,"abstract":"The following article investigates the Metaverse and its potential to bolster digital accessibility for persons with disabilities. Through qualitative analysis, we examine responses from eleven experts in digital accessibility, Metaverse development, disability advocacy, and policy formulation. This exploration uncovers key insights into the Metaverse’s current state, its inherent principles, and the challenges and opportunities it presents in terms of accessibility. The findings reveal a mixed state of inclusivity within the Metaverse, highlighting significant advancements along with notable gaps, especially in integrating assistive technologies and ensuring interoperability across different virtual environments. This study emphasizes the Metaverse’s potential to revolutionize experiences for individuals with disabilities, provided that accessibility is embedded in its foundational design. Ethical and legal considerations, such as privacy, non-discrimination, and evolving legal frameworks, are identified as critical factors that shape an inclusive Metaverse. We propose a comprehensive framework that emphasizes technological adaptation and innovation, user-centric design, universal access, social and economic considerations, and global standards. This framework aims to guide future research and policy interventions to foster an inclusive digital environment in the Metaverse. This paper contributes to the emerging discourse on the Metaverse and digital accessibility, offering a nuanced understanding of its complexities and a roadmap for future exploration and development. This underscores the necessity of a multi-faceted approach that incorporates technological innovation, user-centered design, ethical considerations, legal compliance, and continuous research to create an inclusive and accessible Metaverse.","PeriodicalId":508555,"journal":{"name":"Multimodal Technologies and Interaction","volume":" 1153","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140091713","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Contact Resistance Sensing for Touch and Squeeze Interactions 用于触摸和挤压交互的接触电阻传感技术

Multimodal Technologies and Interaction Pub Date : 2024-02-17 DOI: 10.3390/mti8020014

Nianmei Zhou, S. Devleminck, Luc Geurts

引用次数: 0

HoberUI: An Exploration of Kinematic Structures as Interactive Input Devices HoberUI：探索作为交互式输入设备的运动结构

Multimodal Technologies and Interaction Pub Date : 2024-02-13 DOI: 10.3390/mti8020013

Gvidas Razevicius, Anne Roudaut, Abhijit Karnik

引用次数: 0

HoberUI: An Exploration of Kinematic Structures as Interactive Input Devices HoberUI：探索作为交互式输入设备的运动结构

Multimodal Technologies and Interaction Pub Date : 2024-02-13 DOI: 10.3390/mti8020013

Gvidas Razevicius, Anne Roudaut, Abhijit Karnik

引用次数: 0

Asymmetric VR Game Subgenres: Implications for Analysis and Design 非对称虚拟现实游戏子类型：对分析和设计的启示

Multimodal Technologies and Interaction Pub Date : 2024-02-11 DOI: 10.3390/mti8020012

Miah Dawes, Katherine Rackliffe, Amanda Lee Hughes, Derek L. Hansen

{"title":"Asymmetric VR Game Subgenres: Implications for Analysis and Design","authors":"Miah Dawes, Katherine Rackliffe, Amanda Lee Hughes, Derek L. Hansen","doi":"10.3390/mti8020012","DOIUrl":"https://doi.org/10.3390/mti8020012","url":null,"abstract":"This paper identifies subgenres of asymmetric virtual reality (AVR) games and proposes the AVR Game Genre (AVRGG) framework for developing AVR games. We examined 66 games “in the wild” to develop the AVRGG and used it to identify 5 subgenres of AVR games including David(s) vs. Goliath, Hide and Seek, Perspective Puzzle, Order Simulation, and Lifeline. We describe these genres, which account for nearly half of the 66 games reviewed, in terms of the AVRGG framework that highlights salient asymmetries in the mechanics, dynamics, and aesthetics categories. To evaluate the usefulness of the AVRGG framework, we conducted four workshops (two with the AVRGG framework and two without) with novice game designers who generated 16 original AVR game concepts. Comparisons between the workshop groups, observations of the design sessions, focus groups, and surveys showed the promise and limitations of the AVRGG framework as a design tool. We found that novice designers were able to understand and apply the AVRGG framework after only a brief introduction. The observations indicated two primary challenges that AVR designers face: balancing the game between VR and non-VR player(s) and generating original game concepts. The AVRGG framework helped overcome the balancing concerns due to its ability to inspire novice game designers with example subgenres and draw attention to the asymmetric mechanics and competitive/cooperative nature of games. While half of those who used the AVRGG framework to design with created games that fit directly into existing subgenres, the other half viewed the subgenres as “creative constraints” useful in jumpstarting novel game designs that combined, modified, or purposefully avoided existing subgenres. Additional benefits and limitations of the AVRGG framework are outlined in the paper.","PeriodicalId":508555,"journal":{"name":"Multimodal Technologies and Interaction","volume":"144 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139845543","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0