Before hands disappear: Effect of early warning visual feedback method for hand tracking failures in virtual reality.

IF 2.9 3区综合性期刊 Q1 MULTIDISCIPLINARY SCIENCES

PLoS ONE Pub Date : 2025-06-10 eCollection Date: 2025-01-01 DOI:10.1371/journal.pone.0323796

Mucahit Gemici, Vrushank Phadnis, Anil Ufuk Batmaz

{"title":"Before hands disappear: Effect of early warning visual feedback method for hand tracking failures in virtual reality.","authors":"Mucahit Gemici, Vrushank Phadnis, Anil Ufuk Batmaz","doi":"10.1371/journal.pone.0323796","DOIUrl":null,"url":null,"abstract":"<p><p>Virtual hand representation in Head-Mounted Displays (HMDs) offers immersive and intuitive interactions in Virtual Reality (VR). However, current hand tracking algorithms are prone to errors, which can disrupt the user experience and hinder task performance. This paper presents a novel method for providing users with visual feedback when the quality of hand tracking decreases. Our approach employs a notification modal that warns users of potential failures. We identified three common hand tracking failure scenarios and evaluated the effectiveness of our method in two distinct VR tasks: object manipulation and complex assembly tasks. Results show that our early warning system reduces task completion time, lowers hand-tracking failures by up to 83%, decreases errors, improves system usability, and reduces cognitive load. This work contributes to the development of more robust and user-friendly VR HMD applications by enhancing hand tracking reliability, usability, and workload.</p>","PeriodicalId":20189,"journal":{"name":"PLoS ONE","volume":"20 6","pages":"e0323796"},"PeriodicalIF":2.9000,"publicationDate":"2025-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12151392/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PLoS ONE","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1371/journal.pone.0323796","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}

引用次数: 0

Abstract

Virtual hand representation in Head-Mounted Displays (HMDs) offers immersive and intuitive interactions in Virtual Reality (VR). However, current hand tracking algorithms are prone to errors, which can disrupt the user experience and hinder task performance. This paper presents a novel method for providing users with visual feedback when the quality of hand tracking decreases. Our approach employs a notification modal that warns users of potential failures. We identified three common hand tracking failure scenarios and evaluated the effectiveness of our method in two distinct VR tasks: object manipulation and complex assembly tasks. Results show that our early warning system reduces task completion time, lowers hand-tracking failures by up to 83%, decreases errors, improves system usability, and reduces cognitive load. This work contributes to the development of more robust and user-friendly VR HMD applications by enhancing hand tracking reliability, usability, and workload.

查看原文本刊更多论文

手消失前：虚拟现实中预警视觉反馈方法对手跟踪故障的影响。

头戴式显示器（hmd）中的虚拟手表示在虚拟现实（VR）中提供了沉浸式和直观的交互。然而，目前的手部跟踪算法容易出现错误，这会破坏用户体验并影响任务性能。本文提出了一种在手部跟踪质量下降时为用户提供视觉反馈的新方法。我们的方法采用通知模式，警告用户潜在的故障。我们确定了三种常见的手部跟踪故障场景，并评估了我们的方法在两种不同的VR任务中的有效性：对象操作和复杂的组装任务。结果表明，我们的预警系统减少了任务完成时间，减少了高达83%的手部跟踪失败，减少了错误，提高了系统可用性，并减少了认知负荷。这项工作通过提高手部跟踪的可靠性、可用性和工作量，有助于开发更健壮和用户友好的VR头戴式显示器应用。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

PLoS ONE 生物-生物学

CiteScore

6.20

自引率

5.40%

发文量

14242

审稿时长

3.7 months

期刊介绍： PLOS ONE is an international, peer-reviewed, open-access, online publication. PLOS ONE welcomes reports on primary research from any scientific discipline. It provides: * Open-access—freely accessible online, authors retain copyright * Fast publication times * Peer review by expert, practicing researchers * Post-publication tools to indicate quality and impact * Community-based dialogue on articles * Worldwide media coverage