Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1最新文献

VRMController: an input device for navigation activities in virtual reality environments VRMController:虚拟现实环境中导航活动的输入设备

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3014005

Hai-Ning Liang, Yu-hui Shi, Feiyu Lu, Jizhou Yang, Konstantinos Papangelis

{"title":"VRMController: an input device for navigation activities in virtual reality environments","authors":"Hai-Ning Liang, Yu-hui Shi, Feiyu Lu, Jizhou Yang, Konstantinos Papangelis","doi":"10.1145/3013971.3014005","DOIUrl":"https://doi.org/10.1145/3013971.3014005","url":null,"abstract":"Despite the rapid advancement of display capabilities of VR, in the form of wearable goggles like the Oculus for example, there has been relatively limited progress in the development of input devices for this technology. In this paper, we describe an input controller that is aimed at supporting users' navigation activities in virtual reality environments. Navigation is common in VR environments. The traditional game controller for consoles is still a common choice but only now companies are just beginning to introduce new concepts (for example the HTC Vive Controller). In this research we explore the development of an alternative input controller to support users' navigation activities. This process has led to the design and creation of VRMController, an input device based on a mobile phone designed specifically to support single-hand interaction within VR environments. The design VRMController is based on the results of an initial study comparing three input devices: an Xbox game controller, the HTC Vive controller, and a tablet device. Based on feedback from participants about the useful features of the three types of devices, we have distilled five design guidelines and used them to inform the development of VRMController. The results of a second study comparing our controller with an Xbox controller shows that with our controller participants are able to achieve better performance and find that it is easier to use and more usable.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123928464","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 15

Haptic mirror: a platform for active exploration of facial expressions and social interaction by individuals who are blind 触觉镜:一个供盲人主动探索面部表情和社交互动的平台

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3013999

S. Yasmin, S. Panchanathan

引用次数: 8

DovCut: a draft based online video compositing system DovCut:一个基于草稿的在线视频合成系统

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3013980

Guangyu Nie, Yue Liu, Yongtian Wang

引用次数: 0

Research on simulation system of welding robot in Unity3d Unity3d焊接机器人仿真系统的研究

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3013982

J. Pan, Yong Zhuo, Liang Hou, Xiangjian Bu

引用次数: 2

A novel bagged particle filter for object tracking 一种用于目标跟踪的袋装粒子滤波器

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3013997

Haozhi Huang, Yanyan Liang, A. Tsoi, Sio-Long Lo, A. Leung

引用次数: 0

Automatic planar shape segmentation from indoor point clouds 基于室内点云的平面形状自动分割

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3014008

Wuyang Shui, Jin Liu, Pu Ren, S. Maddock, Mingquan Zhou

{"title":"Automatic planar shape segmentation from indoor point clouds","authors":"Wuyang Shui, Jin Liu, Pu Ren, S. Maddock, Mingquan Zhou","doi":"10.1145/3013971.3014008","DOIUrl":"https://doi.org/10.1145/3013971.3014008","url":null,"abstract":"The use of a terrestrial laser scanner (TLS) has become a popular technique for the acquisition of 3D scenes in architecture and design. Surface reconstruction is used to generate a digital model from the acquired point clouds. However, the model often consists of excessive data, limiting real-time user experiences that make use of the model. In this study, we present a coarse to fine planar shape segmentation method for indoor point clouds, which results in the digital model of an indoor scene being represented by a small number of planar patches. First, the Gaussian map and region growing techniques are used to coarsely segment the planar shape from sampled point clouds. Then, the best-fit-plane is calculated by random sample consensus (RANSAC), avoiding the negative impact of outliers. Finally, the refinement of planar shape is produced by projecting point clouds onto the corresponding bestfit-plane. Our method has been demonstrated to be robust towards noise and outliers in the scanned point clouds and overcomes the limitations of over- and under-segmentation. We have tested our system and algorithms on real datasets and experiments show the reliability of the proposed method against existing region-growing methods.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130096645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Facial expressions recognition based on convolutional neural networks for mobile virtual reality 基于卷积神经网络的移动虚拟现实面部表情识别

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3014025

Teng Teng, Xubo Yang

{"title":"Facial expressions recognition based on convolutional neural networks for mobile virtual reality","authors":"Teng Teng, Xubo Yang","doi":"10.1145/3013971.3014025","DOIUrl":"https://doi.org/10.1145/3013971.3014025","url":null,"abstract":"We present a new system designed for enabling direct face-to-face interaction for users wearing a head-mounted displays (HMD) in virtual reality environment. Due to HMD's occlusion of a user's face, VR applications and games are mainly designed for single user. Even in some multi-player games, players can only communicate with each other using audio input devices or controllers. To address this problem, we develop a novel system that allows users to interact with each other using facial expressions in real-time. Our system consists of two major components: an automatic tracking and segmenting face processing component and a facial expressions recognizing component based on convolutional neural networks (CNN). First, our system tracks a specific marker on the front surface of the HMD and then uses the extracted spatial data to estimate face positions and rotations for mouth segmentation. At last, with the help of an adaptive approach for histogram based mouth segmentation [Panning et al. 2009], our system passes the processed lips pixels' information to CNN and get the facial expressions results in real-time. The results of our experiments show that our system can effectively recognize the basic expressions of users.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122913759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 11

FPGA design & implementation of a very-low-latency video-see-through (VLLV) head-mount display (HMD) system for mixed reality (MR) applications 用于混合现实(MR)应用的极低延迟视频透视(VLLV)头戴式显示(HMD)系统的FPGA设计和实现

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3014020

T. Ai

{"title":"FPGA design & implementation of a very-low-latency video-see-through (VLLV) head-mount display (HMD) system for mixed reality (MR) applications","authors":"T. Ai","doi":"10.1145/3013971.3014020","DOIUrl":"https://doi.org/10.1145/3013971.3014020","url":null,"abstract":"There has been a trend of increasing scales in many Augmented Reality (AR) and Mixed Reality (MR) applications, in both capturing size of the environment using SLAM, or displaying Field of View (FOV) of the digital imageries. However, the Optical See-Through (OST) methods have limited FOV and involve complex design and fabrication. Video See-Through (VST) Head-Mount Display (HMD), on the other hand, has much larger FOV and is easier/cheaper to manufacture. Moreover, it is relatively easy to make virtual objects occlude world objects in video stream. But the drawbacks is that a huge lag is imposed on all contents (i.e. world imagery and digital content) due to video capturing, processing, and rendering. In this paper, we present a system that implements a stereo VST HMD with world imagery that has high quality (2560×1440 @ 90fps) and low latency (≤30ms). The system utilizes an FPGA that splits the world imagery stream into two datapaths, for high-resolution displaying and low-resolution processing. Thus the SLAM algorithm running on the connected computer is performed on a down-sampled video stream for overlaying digital objects. Before being displayed, the processed video from the computer is synchronized and fused with the high-resolution world imagery.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"148 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132785031","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Evaluating virtual reality experience and performance: a brain based approach 评估虚拟现实体验和性能:基于大脑的方法

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3014012

M. Pike, Eugene Ch’ng

{"title":"Evaluating virtual reality experience and performance: a brain based approach","authors":"M. Pike, Eugene Ch’ng","doi":"10.1145/3013971.3014012","DOIUrl":"https://doi.org/10.1145/3013971.3014012","url":null,"abstract":"The recent trend and parallel development/adoption of Virtual Reality, Brain Sensing Measures and associated technology such as Augmented Reality by large corporations, and the rise in the interests in the consumer market have set a positive tone for research in these disciplines. An important human factors area that is a catalyst to broad VR applications is the measure of perception, mental workload, and immersion amongst other issues, which are determining factors in the experience of using virtual environments. Traditional approaches in studying these issues use well-developed subjective measures via questionnaires. A new opportunity in the parallel developments in wearable physiological sensors such as brain scanners could potentially be an objective approach in resolving many subjective uncertainties amongst other prospects. Here, we propose the integration of these two emerging fields in order to provide a continuous, objective, physiological measure of an individual's VR experience for the purposes of enhancing user experience and improving performance. This positional paper attempts to merge two complementary field of work, and discusses implications which could potentially open up avenues of research which were traditionally difficult due to the limitations of equipment, or the lack of quantified approach.","PeriodicalId":269563,"journal":{"name":"Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123336854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 11

An improved ANN search algorithm for visual search applications 一种用于视觉搜索应用的改进人工神经网络搜索算法

Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 Pub Date : 2016-12-03 DOI: 10.1145/3013971.3014011

Fuqiang Ma, Jing Chen, Yanfeng Tong, Lei Sun

引用次数: 0