Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1最新文献

筛选
英文 中文
VRMController: an input device for navigation activities in virtual reality environments VRMController:虚拟现实环境中导航活动的输入设备
Hai-Ning Liang, Yu-hui Shi, Feiyu Lu, Jizhou Yang, Konstantinos Papangelis
{"title":"VRMController: an input device for navigation activities in virtual reality environments","authors":"Hai-Ning Liang, Yu-hui Shi, Feiyu Lu, Jizhou Yang, Konstantinos Papangelis","doi":"10.1145/3013971.3014005","DOIUrl":"https://doi.org/10.1145/3013971.3014005","url":null,"abstract":"Despite the rapid advancement of display capabilities of VR, in the form of wearable goggles like the Oculus for example, there has been relatively limited progress in the development of input devices for this technology. In this paper, we describe an input controller that is aimed at supporting users' navigation activities in virtual reality environments. Navigation is common in VR environments. The traditional game controller for consoles is still a common choice but only now companies are just beginning to introduce new concepts (for example the HTC Vive Controller). In this research we explore the development of an alternative input controller to support users' navigation activities. This process has led to the design and creation of VRMController, an input device based on a mobile phone designed specifically to support single-hand interaction within VR environments. The design VRMController is based on the results of an initial study comparing three input devices: an Xbox game controller, the HTC Vive controller, and a tablet device. Based on feedback from participants about the useful features of the three types of devices, we have distilled five design guidelines and used them to inform the development of VRMController. The results of a second study comparing our controller with an Xbox controller shows that with our controller participants are able to achieve better performance and find that it is easier to use and more usable.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123928464","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Haptic mirror: a platform for active exploration of facial expressions and social interaction by individuals who are blind 触觉镜:一个供盲人主动探索面部表情和社交互动的平台
S. Yasmin, S. Panchanathan
{"title":"Haptic mirror: a platform for active exploration of facial expressions and social interaction by individuals who are blind","authors":"S. Yasmin, S. Panchanathan","doi":"10.1145/3013971.3013999","DOIUrl":"https://doi.org/10.1145/3013971.3013999","url":null,"abstract":"To people who are visually impaired, sensory substitution requires conversion from distal visual data to proximal haptic cue. The challenge is to identify the optimum haptic cues that will make a common haptic \"language\", which can eventually be used to convey information about facial expressions to the individuals who are blind. Once this language has been developed, the next challenge is learning and training. We propose a dynamic haptic tool for simultaneous learning and interaction with a proposed haptic language. We call this application \"Haptic mirror\", an interactive haptic-based reflection of one's self which can be comparable to a visual mirror. Once the user has acquired this language, it can be used to convey the facial expressions of social peers.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114778685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
DovCut: a draft based online video compositing system DovCut:一个基于草稿的在线视频合成系统
Guangyu Nie, Yue Liu, Yongtian Wang
{"title":"DovCut: a draft based online video compositing system","authors":"Guangyu Nie, Yue Liu, Yongtian Wang","doi":"10.1145/3013971.3013980","DOIUrl":"https://doi.org/10.1145/3013971.3013980","url":null,"abstract":"The customization of the video endows users the ability to design the desired videos by themselves, however it is still a challenging task to achieve video composition up to now. In this paper, we design a draft based online video customization system (DovCut) that can convert the freehand draft into a realistic video. Based on a freehand draft in canvas with tags, the proposed system first searches the candidate videos online automatically to match the scene items and segments each candidate object from the background, then replaces the objects in the freehand draft into the realistic objects. By using a filtering scheme the proposed system excludes the undesirable video clips and selects the suitable videos automatically to generate a high quality composition video. Experimental results show the application potential of the proposed system.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115125891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Research on simulation system of welding robot in Unity3d Unity3d焊接机器人仿真系统的研究
J. Pan, Yong Zhuo, Liang Hou, Xiangjian Bu
{"title":"Research on simulation system of welding robot in Unity3d","authors":"J. Pan, Yong Zhuo, Liang Hou, Xiangjian Bu","doi":"10.1145/3013971.3013982","DOIUrl":"https://doi.org/10.1145/3013971.3013982","url":null,"abstract":"In industrial application and teaching training, robot simulation plays an important role. In this paper, the method of system development is discussed. First the robot model and simulation scene model are built. And the kinematics model is established including positive and inverse kinematics. Then two kinds of path, line and circle, are planned about positon and orientation as well. And the pose of torch is discussed for welding. With the help of Unity3d's powerful engine, simulation effects are implemented. Finally, a welding robot simulation system is set up in Unity3d based on Virtual Reality technology. The simulation results show that the system is well applied in engineering and training.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124411726","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A novel bagged particle filter for object tracking 一种用于目标跟踪的袋装粒子滤波器
Haozhi Huang, Yanyan Liang, A. Tsoi, Sio-Long Lo, A. Leung
{"title":"A novel bagged particle filter for object tracking","authors":"Haozhi Huang, Yanyan Liang, A. Tsoi, Sio-Long Lo, A. Leung","doi":"10.1145/3013971.3013997","DOIUrl":"https://doi.org/10.1145/3013971.3013997","url":null,"abstract":"In this paper, we propose a novel bagged particle filter framework to filtering the noise information from object trackers using generative model as well as the discriminative model. The framework makes use of objectness measurement for modeling observation likelihood and two powerful object detectors: the real-time L1 tracker and the TLD tracker combined to bagged trackers. By maxmazing the posterior of the proposed inference, inaccuracy information is filtered and more accuracy result from varying samples returned by different trackers is provided by the bagged particle filter. The experiment results suggest that the proposed particle filter is effective in combing the complementary nature of either the sparse tracking approach and the discriminative learning approach.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129351931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automatic planar shape segmentation from indoor point clouds 基于室内点云的平面形状自动分割
Wuyang Shui, Jin Liu, Pu Ren, S. Maddock, Mingquan Zhou
{"title":"Automatic planar shape segmentation from indoor point clouds","authors":"Wuyang Shui, Jin Liu, Pu Ren, S. Maddock, Mingquan Zhou","doi":"10.1145/3013971.3014008","DOIUrl":"https://doi.org/10.1145/3013971.3014008","url":null,"abstract":"The use of a terrestrial laser scanner (TLS) has become a popular technique for the acquisition of 3D scenes in architecture and design. Surface reconstruction is used to generate a digital model from the acquired point clouds. However, the model often consists of excessive data, limiting real-time user experiences that make use of the model. In this study, we present a coarse to fine planar shape segmentation method for indoor point clouds, which results in the digital model of an indoor scene being represented by a small number of planar patches. First, the Gaussian map and region growing techniques are used to coarsely segment the planar shape from sampled point clouds. Then, the best-fit-plane is calculated by random sample consensus (RANSAC), avoiding the negative impact of outliers. Finally, the refinement of planar shape is produced by projecting point clouds onto the corresponding bestfit-plane. Our method has been demonstrated to be robust towards noise and outliers in the scanned point clouds and overcomes the limitations of over- and under-segmentation. We have tested our system and algorithms on real datasets and experiments show the reliability of the proposed method against existing region-growing methods.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130096645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Facial expressions recognition based on convolutional neural networks for mobile virtual reality 基于卷积神经网络的移动虚拟现实面部表情识别
Teng Teng, Xubo Yang
{"title":"Facial expressions recognition based on convolutional neural networks for mobile virtual reality","authors":"Teng Teng, Xubo Yang","doi":"10.1145/3013971.3014025","DOIUrl":"https://doi.org/10.1145/3013971.3014025","url":null,"abstract":"We present a new system designed for enabling direct face-to-face interaction for users wearing a head-mounted displays (HMD) in virtual reality environment. Due to HMD's occlusion of a user's face, VR applications and games are mainly designed for single user. Even in some multi-player games, players can only communicate with each other using audio input devices or controllers. To address this problem, we develop a novel system that allows users to interact with each other using facial expressions in real-time. Our system consists of two major components: an automatic tracking and segmenting face processing component and a facial expressions recognizing component based on convolutional neural networks (CNN). First, our system tracks a specific marker on the front surface of the HMD and then uses the extracted spatial data to estimate face positions and rotations for mouth segmentation. At last, with the help of an adaptive approach for histogram based mouth segmentation [Panning et al. 2009], our system passes the processed lips pixels' information to CNN and get the facial expressions results in real-time. The results of our experiments show that our system can effectively recognize the basic expressions of users.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122913759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
FPGA design & implementation of a very-low-latency video-see-through (VLLV) head-mount display (HMD) system for mixed reality (MR) applications 用于混合现实(MR)应用的极低延迟视频透视(VLLV)头戴式显示(HMD)系统的FPGA设计和实现
T. Ai
{"title":"FPGA design & implementation of a very-low-latency video-see-through (VLLV) head-mount display (HMD) system for mixed reality (MR) applications","authors":"T. Ai","doi":"10.1145/3013971.3014020","DOIUrl":"https://doi.org/10.1145/3013971.3014020","url":null,"abstract":"There has been a trend of increasing scales in many Augmented Reality (AR) and Mixed Reality (MR) applications, in both capturing size of the environment using SLAM, or displaying Field of View (FOV) of the digital imageries. However, the Optical See-Through (OST) methods have limited FOV and involve complex design and fabrication. Video See-Through (VST) Head-Mount Display (HMD), on the other hand, has much larger FOV and is easier/cheaper to manufacture. Moreover, it is relatively easy to make virtual objects occlude world objects in video stream. But the drawbacks is that a huge lag is imposed on all contents (i.e. world imagery and digital content) due to video capturing, processing, and rendering. In this paper, we present a system that implements a stereo VST HMD with world imagery that has high quality (2560×1440 @ 90fps) and low latency (≤30ms). The system utilizes an FPGA that splits the world imagery stream into two datapaths, for high-resolution displaying and low-resolution processing. Thus the SLAM algorithm running on the connected computer is performed on a down-sampled video stream for overlaying digital objects. Before being displayed, the processed video from the computer is synchronized and fused with the high-resolution world imagery.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"148 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132785031","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
An inverse rendering approach for heterogeneous translucent materials 非均质半透明材料的逆向渲染方法
Jingjie Yang, Shuangjiu Xiao
{"title":"An inverse rendering approach for heterogeneous translucent materials","authors":"Jingjie Yang, Shuangjiu Xiao","doi":"10.1145/3013971.3013973","DOIUrl":"https://doi.org/10.1145/3013971.3013973","url":null,"abstract":"Since heterogeneous translucent materials, such as natural jades and marble, are complex hybrids of different materials, it is difficult to set precise optical parameters for subsurface scattering model as the material really has. In this paper, an inverse rendering approach is presented for heterogeneous translucent materials from a single input photograph. Given one photograph with an object of a certain heterogeneous translucent material, our approach can generate material distribution and estimate heterogeneous optical parameters to render images that look similar to the input photograph. We initialize material distribution using 3D Simplex Noise combined with Fractal Brownian Motion, and set color pattern of the noise using histogram matching method. The volume data with heterogeneous optical parameters is initialized based on the value of color pattern matched noise, and it is rendered in a certain lighting condition using Monte Carlo ray marching method. An iteration process is designed to approximate optical parameters to minimize the difference between rendering result and input photograph. Then the volume data with optimal heterogeneous optical parameters is obtained, which can be used for rendering any geometry model in different lighting conditions. Experimental results show that heterogeneous translucent objects can be rendered precisely similar to the material in the photograph with our approach.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125315495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
A two-dimensional editing system based on hand gestures and real object manipulation using RGB-D sensor 基于RGB-D传感器的基于手势和真实物体操作的二维编辑系统
Hsin-Kai Chen, Sai-Keung Wong, Po-Han Huang, Yu-An Chang
{"title":"A two-dimensional editing system based on hand gestures and real object manipulation using RGB-D sensor","authors":"Hsin-Kai Chen, Sai-Keung Wong, Po-Han Huang, Yu-An Chang","doi":"10.1145/3013971.3013975","DOIUrl":"https://doi.org/10.1145/3013971.3013975","url":null,"abstract":"This paper presents a two-dimensional editing system which compromises the advantages of using hand gestures and real blocks to manipulate virtual objects. The system uses a RGB-D sensor to capture the color and depth images of the hands and real blocks. The raw images of the hands and blocks are segmented. Then we employ a contour based algorithm to perform hand gesture and shape recognition. The contours are extracted and reduced for eliminating the redundant points. After that a set of feature points are collected and they can be used for recognizing the hand gesture and the shapes of the real blocks. The users have two ways to interact with the virtual objects: 1) manipulating the real blocks to control them; and 2) using hand gestures as editing operations to edit them. Experimental results indicate that our system achieves high recognition rate. Our system supports the basic editing operations to the virtual objects, such as 'move', 'scale', 'rotate', and 'copy'. We also conducted a user study which reveals that our system is intuitive and entertaining.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133311940","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书