A Low-cost Efficient Approach to Synchronize Real-world and Virtual-world Objects in VR via In-built Cameras

Chao Liu, Rongkai Shi, Nan Xiang, Jieming Ma, Hai-Ning Liang
{"title":"A Low-cost Efficient Approach to Synchronize Real-world and Virtual-world Objects in VR via In-built Cameras","authors":"Chao Liu, Rongkai Shi, Nan Xiang, Jieming Ma, Hai-Ning Liang","doi":"10.1145/3574131.3574439","DOIUrl":null,"url":null,"abstract":"Virtual reality (VR) technology has become a growing force in entertainment, education, science, and manufacturing due to the capability of providing users with immersive experiences and natural interaction. Although common input devices such as controllers, gamepads, and trackpads have been integrated into mainstream VR systems for user-content interaction, they cannot provide users with realistic haptic feedback. Some prior work tracks and maps the physical objects into the virtual space to allow users to interact with these objects directly, which improves users’ sense of reality in the virtual environment. However, most of them use additional hardware sensors, which inevitably increases the cost. In this research, a lightweight approach is proposed to synchronize the positions and motions between physical and digital objects without any extra costs. We use the real-time captured video data from in-built cameras on a VR headset and employ feature points based algorithms to generate projections of the physical objects in the virtual world. Our approach does not rely on additional sensors but just uses components available in a VR headset. Our approach allows users to interact with target objects with their hands directly without the need for specially designed trackers, markers, and other hardware devices as used in previous work. With our approach, users can get more realistic operational feedback when interacting with corresponding virtual objects.","PeriodicalId":111802,"journal":{"name":"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry","volume":"236 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3574131.3574439","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Virtual reality (VR) technology has become a growing force in entertainment, education, science, and manufacturing due to the capability of providing users with immersive experiences and natural interaction. Although common input devices such as controllers, gamepads, and trackpads have been integrated into mainstream VR systems for user-content interaction, they cannot provide users with realistic haptic feedback. Some prior work tracks and maps the physical objects into the virtual space to allow users to interact with these objects directly, which improves users’ sense of reality in the virtual environment. However, most of them use additional hardware sensors, which inevitably increases the cost. In this research, a lightweight approach is proposed to synchronize the positions and motions between physical and digital objects without any extra costs. We use the real-time captured video data from in-built cameras on a VR headset and employ feature points based algorithms to generate projections of the physical objects in the virtual world. Our approach does not rely on additional sensors but just uses components available in a VR headset. Our approach allows users to interact with target objects with their hands directly without the need for specially designed trackers, markers, and other hardware devices as used in previous work. With our approach, users can get more realistic operational feedback when interacting with corresponding virtual objects.
一种低成本高效的方法来同步现实世界和虚拟世界的对象在VR中通过内置摄像头
虚拟现实(VR)技术由于能够为用户提供身临其境的体验和自然的交互,已经成为娱乐,教育,科学和制造业中日益增长的力量。虽然控制器、游戏手柄、触控板等常见的输入设备已经集成到主流的VR系统中进行用户内容交互,但它们无法为用户提供真实的触觉反馈。先前的一些工作将物理对象跟踪并映射到虚拟空间中,使用户可以直接与这些对象进行交互,从而提高用户在虚拟环境中的真实感。然而,它们中的大多数使用额外的硬件传感器,这不可避免地增加了成本。在这项研究中,提出了一种轻量级的方法来同步物理和数字对象之间的位置和运动,而不需要任何额外的成本。我们使用VR头显上内置摄像头实时捕获的视频数据,并采用基于特征点的算法来生成虚拟世界中物理对象的投影。我们的方法不依赖于额外的传感器,而只是使用VR头显中可用的组件。我们的方法允许用户直接用手与目标物体进行交互,而不需要像以前的工作那样使用专门设计的跟踪器、标记和其他硬件设备。通过我们的方法,用户可以在与相应的虚拟对象交互时获得更真实的操作反馈。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信