{"title":"Telemetry-Based Haptic Rendering for Racing Game Experience Improvement","authors":"Jiwan Lee;Junwoo Kim;Jeonggoo Kang;Eunsoo Jo;Dong Chul Park;Seungmoon Choi","doi":"10.1109/TOH.2024.3357885","DOIUrl":"10.1109/TOH.2024.3357885","url":null,"abstract":"Many recent games, such as racing and flight games, open their game telemetry data to users by storing them in the local memory. Such telemetry data can provide useful information for haptic rendering, and this advantage has been exploited by the industry. This approach applies to any applications that export telemetry data in run time. The haptic rendering module operates as a separate process that accesses the telemetry data in parallel with the application. It is simple, efficient, and modular while retaining the application intact. We examine the approach's viability for user experience improvement by developing three telemetry-based haptic rendering algorithms for car racing games. They express the car engine response, collisions with external objects, and the road surface texture, respectively. Building a haptics-enabled driving platform, we conducted a user study comparing gaming experiences between our telemetry-based algorithms and conventional sound-to-tactile conversion algorithms. The results showed that the telemetry-based effects elicited better experiences than the sound-based effects.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 1","pages":"72-79"},"PeriodicalIF":2.9,"publicationDate":"2024-01-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139546259","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bumps and Dents are Not Perceptually Opposite When Exploring With Lateral Force Cues","authors":"Mirai Azechi;Shogo Okamoto","doi":"10.1109/TOH.2024.3357806","DOIUrl":"10.1109/TOH.2024.3357806","url":null,"abstract":"Virtual tactile bumps and dents are presented by controlling frictional forces on a surface tactile display, a flat touch screen with tactile feedback functions. This technology enables users to touch and feel three-dimensional objects. The resistive force against a sliding finger is increased and then decreased compared to a base level to present a bump. The order of increase and decrease is inverted for a dent. Thus, the difference between bump and dent presentations lies in the change order of the resistive force. However, bumps and dents are not simply opposite when investigating psychophysical functions with only lateral force cues available, without height and depth information. The results demonstrate that bumps are more easily detected with high surface gradients or resultant force changes and small widths. In contrast, these parameters do not influence the detection of dents among different participants. These findings contribute to a deeper understanding of tactile perception of surface shapes.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 1","pages":"52-57"},"PeriodicalIF":2.9,"publicationDate":"2024-01-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139546255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gen Ohara;Daiki Kikuchi;Masashi Konyo;Satoshi Tadokoro
{"title":"Stereohaptic Vibration: Out-of-Body Localization of Virtual Vibration Source Through Multiple Vibrotactile Stimuli on the Forearms","authors":"Gen Ohara;Daiki Kikuchi;Masashi Konyo;Satoshi Tadokoro","doi":"10.1109/TOH.2024.3357574","DOIUrl":"10.1109/TOH.2024.3357574","url":null,"abstract":"This paper proposes a novel concept of “stereohaptic vibration,” which employs distributed vibration to localize vibration sources outside the body. Inspired by amplitude panning, a stereophonic sound display technique, we developed a method to localize a virtual vibration source (VVS) by polarizing the perceived intensity of multiple vibration stimuli to a specific orientation. Considering the perceptual characteristics of high-frequency vibration, the perceived intensity of the VVS was allocated to multiple vibrators according to the distance and direction of the target. The velocity discrimination performance was confirmed by utilizing four stimuli around the arm and one vibration stimulus to the palm to localize the movement of a VVS throughout the arm. Discrimination experiments of the trajectory of outgoing objects with a single arm and dual arms revealed that our approach could localize in three dimensions, even outside the body. The proposed technology for localizing external virtual vibration sources is expected to enhance the virtual reality experience.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 1","pages":"86-91"},"PeriodicalIF":2.9,"publicationDate":"2024-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139540810","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Haptic Interactions Subject to Variable Latency","authors":"Chantal Hutchison;Joseph Hewlett;Siamak Arbatani;Antoine Weill-Duflos;József Kövecses","doi":"10.1109/TOH.2024.3357070","DOIUrl":"10.1109/TOH.2024.3357070","url":null,"abstract":"Model-Mediated Teleoperation (MMT) between a haptic device and a remote or virtual environment uses a local model of the environment to compensate for latency of communication. MMT is often case-specific, and requires underlying latency distributions to be known. We propose a novel approach – which we refer to as the DelayRIM – which uses the time-stepping aspect of a Reduced Interface Model for the environment to render an up-to-date force to the haptic device from the delayed information. RIM is applicable to any physical or virtual system, and the DelayRIM itself makes no underlying assumption about the latency distribution. We show that for realistic variable delays, the DelayRIM improves transparency compared to other methods for a virtual drone bilateral teleoperation scenario.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 1","pages":"66-71"},"PeriodicalIF":2.9,"publicationDate":"2024-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139542302","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Daziyah H. Sullivan;Elyse D. Z. Chase;Marcia K. O'Malley
{"title":"Comparing the Perceived Intensity of Vibrotacitle Cues Scaled Based on Inherent Dynamic Range","authors":"Daziyah H. Sullivan;Elyse D. Z. Chase;Marcia K. O'Malley","doi":"10.1109/TOH.2024.3355203","DOIUrl":"10.1109/TOH.2024.3355203","url":null,"abstract":"Wearable devices increasingly incorporate vibrotactile feedback notifications to users, which are limited by the frequency-dependent response characteristics of the low-cost actuators that they employ. To increase the range and type of information that can be conveyed to users via vibration feedback, it is crucial to understand user perception of vibration cue intensity across the narrow range of frequencies that these actuators operate. In this paper, we quantify user perception of vibration cues conveyed via a linear resonant actuator embedded in a bracelet interface using two psychophysical experiments. We also experimentally determine the frequency response characteristics of the wearable device. We then compare user perceived intensity of vibration cues delivered by the bracelet when the cues undergo frequency-specific amplitude modulation based on user perception compared to modulation based on the experimental or manufacturer-reported characterization of the actuator dynamic response. For applications in which designers rely on user perception of cue amplitudes across frequencies to be equivalent, it is recommended that a perceptual calibration experiment be conducted to determine appropriate modulation factors. For applications in which only relative perceived amplitudes are important, basing amplitude modulation factors on manufacturer data or experimentally determined dynamic response characteristics of the wearable device should be sufficient.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 1","pages":"45-51"},"PeriodicalIF":2.9,"publicationDate":"2024-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139519884","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Behnam Khojasteh;Yitian Shao;Katherine J. Kuchenbecker
{"title":"Robust Surface Recognition With the Maximum Mean Discrepancy: Degrading Haptic-Auditory Signals Through Bandwidth and Noise","authors":"Behnam Khojasteh;Yitian Shao;Katherine J. Kuchenbecker","doi":"10.1109/TOH.2024.3356609","DOIUrl":"10.1109/TOH.2024.3356609","url":null,"abstract":"Sliding a tool across a surface generates rich sensations that can be analyzed to recognize what is being touched. However, the optimal configuration for capturing these signals is yet unclear. To bridge this gap, we consider haptic-auditory data as a human explores surfaces with different steel tools, including accelerations of the tool and finger, force and torque applied to the surface, and contact sounds. Our classification pipeline uses the maximum mean discrepancy (MMD) to quantify differences in data distributions in a high-dimensional space for inference. With recordings from three hemispherical tool diameters and ten diverse surfaces, we conducted two degradation studies by decreasing sensing bandwidth and increasing added noise. We evaluate the haptic-auditory recognition performance achieved with the MMD to compare newly gathered data to each surface in our known library. The results indicate that acceleration signals alone have great potential for high-accuracy surface recognition and are robust against noise contamination. The optimal accelerometer bandwidth exceeds 1000 Hz, suggesting that useful vibrotactile information extends beyond human perception range. Finally, smaller tool tips generate contact vibrations with better noise robustness. The provided sensing guidelines may enable superhuman performance in portable surface recognition, which could benefit quality control, material documentation, and robotics.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 1","pages":"58-65"},"PeriodicalIF":2.9,"publicationDate":"2024-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10411097","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139519892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zhenyu Liu;Jin-Tae Kim;John A. Rogers;Roberta L. Klatzky;J. Edward Colgate
{"title":"Realism of Tactile Texture Playback: A Combination of Stretch and Vibration","authors":"Zhenyu Liu;Jin-Tae Kim;John A. Rogers;Roberta L. Klatzky;J. Edward Colgate","doi":"10.1109/TOH.2024.3355982","DOIUrl":"10.1109/TOH.2024.3355982","url":null,"abstract":"This study investigates the effects of two stimulation modalities (stretch and vibration) on natural touch sensation on the volar forearm. The skin-textile interaction was implemented by scanning three textures across the left forearm. The resulting skin displacements were recorded by the digital image correlation technique to capture the information imparted by the textures. The texture recordings were used to create three playback modes (stretch, vibration, and both), which were reproduced on the right forearm. Two psychophysical experiments compared the texture scans to rendered texture playbacks. The first experiment used a matching task and found that to maximize perceptual realism, i.e., similarity to a physical reference, subjects preferred the rendered texture to have a playback intensity of 1X – 2X higher on DC components (stretch), and 1X – 3.5X higher on AC components (vibration), varying across textures. The second experiment elicited similarity ratings between the texture scans and playbacks and showed that a combination of stretch and vibration was required to create differentiated texture sensations. However, the intensity amplification and use of two stimuli were still insufficient to create fully realistic texture sensations. We conclude that mechanisms beyond single-site uniaxial stimuli are needed to reproduce realistic textural sensations.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 3","pages":"441-450"},"PeriodicalIF":2.4,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139502435","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Spatiotemporal Modulation for Ultrasonic Mid-Air Haptics: Sensation's Specification and Validation","authors":"Eduardo Mendes;Paulo Santos;João Carvalho;Jorge Cabral","doi":"10.1109/TOH.2024.3355187","DOIUrl":"10.1109/TOH.2024.3355187","url":null,"abstract":"Spatiotemporal modulation (STM) is used in Ultrasonic Mid-Air Haptics to create compelling tactile sensations. The STM can create perceptually distinct sensations. We specified the sensations of a palm-size pattern by varying the focal point's speed and pattern sampling rate. Three sensations were specified, named as Dynamic, Vibratory and Uniform. A selective identification study was conducted to evaluate if the sensations were recognizable to the perception when presented individually and simultaneously (combined stimuli). The results support the STM's specification and the selective recognition of the sensations was possible for some combinations.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 3","pages":"429-440"},"PeriodicalIF":2.4,"publicationDate":"2024-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139485539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Horizontal Plane Haptic Redirection: Realizing Haptic Feedback for the Virtual Inclined Plane in VR","authors":"Dexin Liu;Hengxin Chen","doi":"10.1109/TOH.2024.3354514","DOIUrl":"10.1109/TOH.2024.3354514","url":null,"abstract":"Some interactions in virtual environments need to be operated on inclined planes. If a real inclined plane can be found in the real environment that corresponds exactly to the angle of the virtual inclined plane to provide haptic feedback, the user's immersion can be enhanced. However, it is not easy to find such a real inclined plane in the real environment. We proposed a horizontal plane haptic redirection scheme, where users interacting with virtual inclined planes in virtual environments can obtain haptic feelings by using real horizontal planes that are easily available in the real world for redirection mapping. We also designed an integrated solution to locate the real horizontal plane and for haptic redirection based on the Vive Pro headset. Then we measured the angle and size thresholds for horizontal plane haptic redirection as 20° and 88%, respectively, through a user study. Through experiments, we also found that when the degree of redirection exceeded the threshold, the user's operation efficiency would be significantly reduced. In addition, we compared the horizontal plane haptic redirection scheme with the scheme without redirection and the scheme without haptic feedback to demonstrate the validity and necessity of the redirection scheme proposed in this paper.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 1","pages":"26-32"},"PeriodicalIF":2.9,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139472317","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multimodal Haptic Feedback for Virtual Collisions Combining Vibrotactile and Electrical Muscle Stimulation","authors":"Jungeun Lee;Seungmoon Choi","doi":"10.1109/TOH.2024.3354268","DOIUrl":"10.1109/TOH.2024.3354268","url":null,"abstract":"In this paper, we explore the effects of multimodal haptic feedback combining vibrotactile and electrical muscle stimulation (EMS) on expressing virtual collisions. We first present a wearable multimodal haptic device capable of generating both mechanical vibration and EMS stimuli. The two types of haptic stimulus are combined into a haptic rendering method that conveys improved virtual collision sensations. This multimodal rendering method highlights the strengths of each modality while compensating for mutual weaknesses. The multimodal rendering method is compared in subjective quality with two unimodal methods (vibration only and EMS only) by a user study. Experimental results demonstrate that our multimodal feedback method can elicit more realistic, enjoyable, expressive, and preferable user experiences.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 1","pages":"33-38"},"PeriodicalIF":2.9,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139472324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}