Perception of Soft Objects in Virtual Environments Under Conflicting Visual and Haptic Cues

IF 2.4 3区计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS

IEEE Transactions on Haptics Pub Date : 2023-10-05 DOI:10.1109/TOH.2023.3322189

Cagatay Basdogan;Berke Ataseven;Mandayam A. Srinivasan

{"title":"Perception of Soft Objects in Virtual Environments Under Conflicting Visual and Haptic Cues","authors":"Cagatay Basdogan;Berke Ataseven;Mandayam A. Srinivasan","doi":"10.1109/TOH.2023.3322189","DOIUrl":null,"url":null,"abstract":"In virtual/augmented/mixed reality (VR/AR/MR) applications, rendering soft virtual objects using a hand-held haptic device is challenging due to the anatomical restrictions of the hand and the ungrounded nature of the design, which affect the selection of actuators and sensors and hence limit the resolution and range of forces displayed by the device. We developed a cable-driven haptic device for rendering the net forces involved in grasping and squeezing 3D virtual compliant (soft) objects being held between the index finger and thumb only. Using the proposed device, we investigate the perception of soft objects in virtual environments. We show that the range of object stiffness that can be effectively conveyed to a user in virtual environments (VEs) can be significantly expanded by controlling the relationship between the visual and haptic cues. We propose that a single variable, named \n<italic>Apparent Stiffness Difference</i>\n, can predict the pattern of human stiffness perception under manipulated conflict, which can be used for rendering a range of soft objects in VEs larger than what is achievable by a haptic device alone due to its physical limits.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 2","pages":"227-236"},"PeriodicalIF":2.4000,"publicationDate":"2023-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Haptics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10272716/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}

引用次数: 0

Abstract

In virtual/augmented/mixed reality (VR/AR/MR) applications, rendering soft virtual objects using a hand-held haptic device is challenging due to the anatomical restrictions of the hand and the ungrounded nature of the design, which affect the selection of actuators and sensors and hence limit the resolution and range of forces displayed by the device. We developed a cable-driven haptic device for rendering the net forces involved in grasping and squeezing 3D virtual compliant (soft) objects being held between the index finger and thumb only. Using the proposed device, we investigate the perception of soft objects in virtual environments. We show that the range of object stiffness that can be effectively conveyed to a user in virtual environments (VEs) can be significantly expanded by controlling the relationship between the visual and haptic cues. We propose that a single variable, named Apparent Stiffness Difference , can predict the pattern of human stiffness perception under manipulated conflict, which can be used for rendering a range of soft objects in VEs larger than what is achievable by a haptic device alone due to its physical limits.

查看原文本刊更多论文

在视觉和触觉线索冲突的情况下对虚拟环境中软物体的感知。

在虚拟/增强/混合现实（VR/AR/MR）应用中，由于手的解剖限制和设计的不接地性质，使用手持触觉设备渲染软虚拟对象是具有挑战性的，这影响了致动器和传感器的选择，从而限制了设备显示的力的分辨率和范围。我们开发了一种电缆驱动的触觉设备，用于呈现抓取和挤压仅夹在食指和拇指之间的3D虚拟柔顺（软）物体所涉及的净力。使用所提出的设备，我们研究了虚拟环境中软对象的感知。我们表明，通过控制视觉线索和触觉线索之间的关系，可以显著扩大在虚拟环境（VEs）中可以有效传达给用户的对象刚度范围。我们提出，一个名为“表观刚度差异”的单一变量可以预测人类在操纵冲突下的刚度感知模式，由于其物理限制，该变量可用于渲染视觉中的一系列软对象，这些软对象比单独使用触觉设备所能实现的要大。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

IEEE Transactions on Haptics COMPUTER SCIENCE, CYBERNETICS-

CiteScore

5.90

自引率

13.80%

发文量

109

审稿时长

>12 weeks

期刊介绍： IEEE Transactions on Haptics (ToH) is a scholarly archival journal that addresses the science, technology, and applications associated with information acquisition and object manipulation through touch. Haptic interactions relevant to this journal include all aspects of manual exploration and manipulation of objects by humans, machines and interactions between the two, performed in real, virtual, teleoperated or networked environments. Research areas of relevance to this publication include, but are not limited to, the following topics: Human haptic and multi-sensory perception and action, Aspects of motor control that explicitly pertain to human haptics, Haptic interactions via passive or active tools and machines, Devices that sense, enable, or create haptic interactions locally or at a distance, Haptic rendering and its association with graphic and auditory rendering in virtual reality, Algorithms, controls, and dynamics of haptic devices, users, and interactions between the two, Human-machine performance and safety with haptic feedback, Haptics in the context of human-computer interactions, Systems and networks using haptic devices and interactions, including multi-modal feedback, Application of the above, for example in areas such as education, rehabilitation, medicine, computer-aided design, skills training, computer games, driver controls, simulation, and visualization.