Journal on Multimodal User Interfaces最新文献_第2页

Review of substitutive assistive tools and technologies for people with visual impairments: recent advancements and prospects 视障人士替代性辅助工具和技术回顾：最新进展与前景

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-12-19 DOI: 10.1007/s12193-023-00427-4

Zahra J. Muhsin, Rami Qahwaji, Faruque Ghanchi, Majid Al-Taee

{"title":"Review of substitutive assistive tools and technologies for people with visual impairments: recent advancements and prospects","authors":"Zahra J. Muhsin, Rami Qahwaji, Faruque Ghanchi, Majid Al-Taee","doi":"10.1007/s12193-023-00427-4","DOIUrl":"https://doi.org/10.1007/s12193-023-00427-4","url":null,"abstract":"<p>The development of many tools and technologies for people with visual impairment has become a major priority in the field of assistive technology research. However, many of these technology advancements have limitations in terms of the human aspects of the user experience (e.g., usability, learnability, and time to user adaptation) as well as difficulties in translating research prototypes into production. Also, there was no clear distinction between the assistive aids of adults and children, as well as between “partial impairment” and “total blindness”. As a result of these limitations, the produced aids have not gained much popularity and the intended users are still hesitant to utilise them. This paper presents a comprehensive review of substitutive interventions that aid in adapting to vision loss, centred on laboratory research studies to assess user-system interaction and system validation. Depending on the primary cueing feedback signal offered to the user, these technology aids are categorized as visual, haptics, or auditory-based aids. The context of use, cueing feedback signals, and participation of visually impaired people in the evaluation are all considered while discussing these aids. Based on the findings, a set of recommendations is suggested to assist the scientific community in addressing persisting challenges and restrictions faced by both the totally blind and partially sighted people.</p>","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138742323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Augmented reality and deep learning based system for assisting assembly process 基于增强现实和深度学习的装配辅助系统

IF 2.9 3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-12-14 DOI: 10.1007/s12193-023-00428-3

{"title":"Augmented reality and deep learning based system for assisting assembly process","authors":"","doi":"10.1007/s12193-023-00428-3","DOIUrl":"https://doi.org/10.1007/s12193-023-00428-3","url":null,"abstract":"<h3>Abstract</h3> <p>In Industry 4.0, manufacturing entails a rapid change in customer demands which leads to mass customization. The variation in customer requirements leads to small batch sizes and several process variations. Assembly task is one of most important steps in any manufacturing process. A factory floor worker often needs a guidance system due to variations in product or process, to assist them in assembly task. Existing Augmented Reality (AR) based systems use markers for each assembly component for detection which is time consuming and laborious. This paper proposed utilizing state-of-the-art deep learning based object detection technique and employed a regression based mapping technique to obtain the 3D locations of assembly components. Automatic detection of machine parts was followed by a multimodal interface involving both eye gaze and hand tracking to guide the manual assembly process. We proposed eye cursor to guide the user through the task and utilized fingertip distances along with object sizes to detect any error committed during the task. We analyzed the proposed mapping method and found that the mean mapping error was 1.842 cm. We also investigated the effectiveness of the proposed multimodal user interface by conducting two user studies. The first study indicated that the current interface design with eye cursor enabled participants to perform the task significantly faster compared to the interface without eye cursor. The shop floor workers during the second user study reported that the proposed guidance system was comprehendible and easy to use to complete the assembly task. Results showed that the proposed guidance system enabled 11 end users to finish the assembly of one pneumatic cylinder within 55 s with average TLX score less than 25 in a scale of 100 and Cronbach alpha score of 0.8 indicating convergence of learning experience.</p>","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138684924","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Modelling the “transactive memory system” in multimodal multiparty interactions 多模态多方交互中的“交互记忆系统”建模

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-11-11 DOI: 10.1007/s12193-023-00426-5

Beatrice Biancardi, Maurizio Mancini, Brian Ravenet, Giovanna Varni

引用次数: 0

Model-based sonification based on the impulse pattern formulation 基于脉冲模式公式的模型超声

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-11-06 DOI: 10.1007/s12193-023-00423-8

Simon Linke, Rolf Bader, Robert Mores

引用次数: 0

Introduction to the special issue on design and perception of interactive sonification 介绍互动式声效的设计与感知专题

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-11-02 DOI: 10.1007/s12193-023-00425-6

Tim Ziemer, Sara Lenzi, Niklas Rönnberg, Thomas Hermann, Roberto Bresin

引用次数: 0

Correction to: PepperOSC: enabling interactive sonification of a robot’s expressive movement 更正:PepperOSC:使机器人的表达运动的交互式声音

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-30 DOI: 10.1007/s12193-023-00424-7

Adrian B. Latupeirissa, Roberto Bresin

引用次数: 0

Three-dimensional sonification as a surgical guidance tool 三维超声作为手术指导工具

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-27 DOI: 10.1007/s12193-023-00422-9

Ziemer, Tim

引用次数: 1

A study on the attention of people with low vision to accessibility guidance signs 弱视人群对无障碍引导标志注意的研究

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-26 DOI: 10.1007/s12193-023-00417-6

Weitao Jiang, Bingxin Zhang, Ruiqi Sun, Dong Zhang, Shan Hu

引用次数: 0

An interdisciplinary journey towards an aesthetics of sonification experience 一个跨学科的旅程走向美学的声音体验

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-21 DOI: 10.1007/s12193-023-00416-7

Mariana Seiça, Licínio Roque, Pedro Martins, F. Amílcar Cardoso

{"title":"An interdisciplinary journey towards an aesthetics of sonification experience","authors":"Mariana Seiça, Licínio Roque, Pedro Martins, F. Amílcar Cardoso","doi":"10.1007/s12193-023-00416-7","DOIUrl":"https://doi.org/10.1007/s12193-023-00416-7","url":null,"abstract":"Abstract The aesthetic dimension has been proposed as a potential expansion of sonification design, creating listening pieces that reach the goal of effective data communication. However, current views of aesthetics still aim at optimising mapping criteria to convey the ‘right meaning’, maintaining a mostly functional view on what is considered a successful sonification. This paper proposes an interdisciplinary approach to the aesthetics of sonification experience, grounded on theoretical foundations from phenomenology of interaction, post-phenomenology, cross-cultural studies, acoustic ecology and deep listening. From this journey, we present the following design insights: (1) the design of sonifications becomes a design for experience, (2) co-designed during the interaction with each participant; (3) the sonification artefact gains a mediating role that guides the participant’s intentions in the sonification space; (4) the aesthetics of a sonification experience generates a multistable phenomenon, offering new opportunities to experience multiple perspectives over data; (5) the interaction between human participants and the sonic emanations compose a dialogic space. A call for action to reframe the sonification field into novel design spaces is now open, with aesthetics gaining a transformational role in sonification design and interaction.","PeriodicalId":17529,"journal":{"name":"Journal on Multimodal User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135463803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Comparing alternative modalities in the context of multimodal human–robot interaction 在多模态人机交互的背景下比较不同的模态

3区计算机科学

Journal on Multimodal User Interfaces Pub Date : 2023-10-19 DOI: 10.1007/s12193-023-00421-w

Suprakas Saren, Abhishek Mukhopadhyay, Debasish Ghose, Pradipta Biswas

引用次数: 0