Decoding Realism of Virtual Objects: Exploring Behavioral and Ocular Reactions to Inaccurate Interaction Feedback

IF 4.8 2区计算机科学 Q1 COMPUTER SCIENCE, CYBERNETICS

ACM Transactions on Computer-Human Interaction Pub Date : 2024-04-18 DOI:10.1145/3660345

Leonie Terfurth, Klaus Gramann, Lukas Gehrke

{"title":"Decoding Realism of Virtual Objects: Exploring Behavioral and Ocular Reactions to Inaccurate Interaction Feedback","authors":"Leonie Terfurth, Klaus Gramann, Lukas Gehrke","doi":"10.1145/3660345","DOIUrl":null,"url":null,"abstract":"Achieving temporal synchrony between sensory modalities is crucial for natural perception of object interaction in virtual reality. While subjective questionnaires are currently used to evaluate users’ VR experiences, leveraging behavior and psychophysiological responses can provide additional insights.We investigated motion and ocular behavior as discriminators between realistic and unrealistic object interactions. Participants grasped and placed a virtual object while experiencing sensory feedback that either matched their expectations or occurred too early. We also explored visual-only feedback vs. combined visual and haptic feedback. Due to technological limitations, a condition with delayed feedback was added post-hoc.Gaze-based metrics revealed discrimination between high and low feedback realism. Increased interaction uncertainty was associated with longer fixations on the avatar hand and temporal shifts in the gaze-action relationship. Our findings enable real-time evaluation of users’ perception of realism in interactions. They facilitate the optimization of interaction realism in virtual environments and beyond.","PeriodicalId":50917,"journal":{"name":"ACM Transactions on Computer-Human Interaction","volume":"38 1","pages":""},"PeriodicalIF":4.8000,"publicationDate":"2024-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Transactions on Computer-Human Interaction","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1145/3660345","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}

引用次数: 0

Abstract

Achieving temporal synchrony between sensory modalities is crucial for natural perception of object interaction in virtual reality. While subjective questionnaires are currently used to evaluate users’ VR experiences, leveraging behavior and psychophysiological responses can provide additional insights.

We investigated motion and ocular behavior as discriminators between realistic and unrealistic object interactions. Participants grasped and placed a virtual object while experiencing sensory feedback that either matched their expectations or occurred too early. We also explored visual-only feedback vs. combined visual and haptic feedback. Due to technological limitations, a condition with delayed feedback was added post-hoc.

Gaze-based metrics revealed discrimination between high and low feedback realism. Increased interaction uncertainty was associated with longer fixations on the avatar hand and temporal shifts in the gaze-action relationship. Our findings enable real-time evaluation of users’ perception of realism in interactions. They facilitate the optimization of interaction realism in virtual environments and beyond.

查看原文本刊更多论文

解码虚拟对象的逼真度：探索行为和视觉对不准确交互反馈的反应

实现感官模式之间的时间同步对于自然感知虚拟现实中的物体交互至关重要。虽然目前使用主观问卷来评估用户的 VR 体验，但利用行为和心理生理反应可以提供更多的见解。参与者在抓取和放置虚拟物体时，会体验到符合其预期或过早出现的感官反馈。我们还探索了纯视觉反馈与视觉和触觉反馈的对比。由于技术限制，我们在事后增加了一个延迟反馈的条件。基于凝视的指标揭示了高和低反馈逼真度之间的区别。交互不确定性的增加与对头像手的固定时间延长和凝视-动作关系的时间变化有关。我们的研究结果能够实时评估用户对交互真实性的感知。它们有助于优化虚拟环境及其他环境中的交互逼真度。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

ACM Transactions on Computer-Human Interaction 工程技术-计算机：控制论

CiteScore

8.50

自引率

5.40%

发文量

审稿时长

>12 weeks

期刊介绍： This ACM Transaction seeks to be the premier archival journal in the multidisciplinary field of human-computer interaction. Since its first issue in March 1994, it has presented work of the highest scientific quality that contributes to the practice in the present and future. The primary emphasis is on results of broad application, but the journal considers original work focused on specific domains, on special requirements, on ethical issues -- the full range of design, development, and use of interactive systems.