2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)最新文献_第2页

A Live Storytelling Virtual Reality System with Programmable Cartoon-Style Emotion Embodiment 具有可编程卡通风格情感体现的实时讲故事虚拟现实系统

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00024

Zhenjie Zhao, Feng Han, Xiaojuan Ma

{"title":"A Live Storytelling Virtual Reality System with Programmable Cartoon-Style Emotion Embodiment","authors":"Zhenjie Zhao, Feng Han, Xiaojuan Ma","doi":"10.1109/AIVR46125.2019.00024","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00024","url":null,"abstract":"Virtual reality (VR) is a promising new medium for immersive storytelling. While previous research works on VR narrative have tried to engage audiences through nice scenes and interactivity, the emerging live streaming shows the role of a presenter, especially the conveyance of emotion, for promoting audience involvement and enjoyment. In this paper, to lower the requirement of emotion embodiment, we borrow experience from cartoon animation and comics, and propose a novel cartoon-style hybrid emotion embodiment model to increase a storyteller's presence during live performance, which contains an avatar with six basic emotions and auxiliary multimodal display to enhance emotion expressing. We further design and implement a system to teleoperate the embodiment model in VR for live storytelling. In particular, 1) we design a novel visual programming tool that allows users to customize emotional effects based on the emotion embodiment model; 2) we design a novel face tracking module to map presenters' emotional states to the avatar in VR. Our lightweight web-based implementation also makes the application very easy to use. We conduct two preliminary qualitative studies to explore the potential of the hybrid model and the storytelling system, including interviews with three experts and a workshop study with local secondary school students. Results show the potential of the VR storytelling system for education.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125499447","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Exploring CNN-Based Viewport Prediction for Live Virtual Reality Streaming 探索基于cnn的实时虚拟现实流的视口预测

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00038

Xianglong Feng, Zeyang Bao, Sheng Wei

引用次数: 12

Effects of Patient Care Assistant Embodiment and Computer Mediation on User Experience 病人护理助理化身与电脑中介对使用者体验的影响

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00013

Kangsoo Kim, Nahal Norouzi, Tiffany Losekamp, G. Bruder, Mindi Anderson, G. Welch

{"title":"Effects of Patient Care Assistant Embodiment and Computer Mediation on User Experience","authors":"Kangsoo Kim, Nahal Norouzi, Tiffany Losekamp, G. Bruder, Mindi Anderson, G. Welch","doi":"10.1109/AIVR46125.2019.00013","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00013","url":null,"abstract":"Providers of patient care environments are facing an increasing demand for technological solutions that can facilitate increased patient satisfaction while being cost effective and practically feasible. Recent developments with respect to smart hospital room setups and smart home care environments have an immense potential to leverage advances in technologies such as Intelligent Virtual Agents, Internet of Things devices, and Augmented Reality to enable novel forms of patient interaction with caregivers and their environment. In this paper, we present a human-subjects study in which we compared four types of simulated patient care environments for a range of typical tasks. In particular, we tested two forms of caregiver mediation with a real person or a virtual agent, and we compared two forms of caregiver embodiment with disembodied verbal or embodied interaction. Our results show that, as expected, a real caregiver provides the optimal user experience but an embodied virtual assistant is also a viable option for patient care environments, providing significantly higher social presence and engagement than voice-only interaction. We discuss the implications in the field of patient care and digital assistant.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129876552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 23

Temporal Interpolation of Dynamic Digital Humans using Convolutional Neural Networks 使用卷积神经网络的动态数字人的时间插值

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00022

Irene Viola, J. Mulder, F. D. Simone, Pablo César

{"title":"Temporal Interpolation of Dynamic Digital Humans using Convolutional Neural Networks","authors":"Irene Viola, J. Mulder, F. D. Simone, Pablo César","doi":"10.1109/AIVR46125.2019.00022","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00022","url":null,"abstract":"In recent years, there has been an increased interest in point cloud representation for visualizing digital humans in cross reality. However, due to their voluminous size, point clouds require high bandwidth to be transmitted. In this paper, we propose a temporal interpolation architecture capable of increasing the temporal resolution of dynamic digital humans, represented using point clouds. With this technique, bandwidth savings can be achieved by transmitting dynamic point clouds in a lower temporal resolution, and recreating a higher temporal resolution on the receiving side. Our interpolation architecture works by first downsampling the point clouds to a lower spatial resolution, then estimating scene flow using a newly designed neural network architecture, and finally upsampling the result back to the original spatial resolution. To improve the smoothness of the results, we additionally apply a novel technique called neighbour snapping. To be able to train and test our newly designed network, we created a synthetic point cloud data set of animated human bodies. Results from the evaluation of our architecture through a small-scale user study show the benefits of our method with respect to the state of the art in scene flow estimation for point clouds. Moreover, correlation between our user study and existing objective quality metrics confirm the need for new metrics to accurately predict the visual quality of point cloud contents.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"37 ","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133621781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

Intent Inference of Human Hand Motion for Haptic Feedback Systems 触觉反馈系统中手部动作的意图推断

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00046

Mengyi Zhao, S. Dai

引用次数: 0

AR Tracking with Hybrid, Agnostic And Browser Based Approach AR跟踪与混合，不可知和基于浏览器的方法

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00036

Amit L. Ahire, Dennis Basgier

{"title":"AR Tracking with Hybrid, Agnostic And Browser Based Approach","authors":"Amit L. Ahire, Dennis Basgier","doi":"10.1109/AIVR46125.2019.00036","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00036","url":null,"abstract":"Mobile platform tools are desirable when it comes to practical augmented reality applications. With the convenience and portability that the form factor has to offer, it lays an ideal basic foundation for a feasible use case in industry and commercial applications. Here, we present a novel approach of using the monocular Simultaneous Localization and Mapping (SLAM) information provided by a Cross-Reality (XR) device to augment the linked 3D CAD models. The main objective is to use the tracking technology for an augmented and mixed reality experience by tracking a 3D model and superimposing its respective 3D CAD model data over the images we receive from the camera feed of the XR device without any scene preparation (e.g markers or feature maps). The intent is to conduct a visual analysis and evaluations based on the intrinsic and extrinsic of the model in the visualization system that instant3Dhub has to offer. To achieve this we make use of the Apple's ARKit to obtain the images, sensor data and SLAM heuristic of client XR device, remote marker-less model based 3D object tracking from monocular RGB image data and hybrid client server architecture. Our approach is agnostic of any SLAM system or Augmented Reality (AR) framework. We make use of the Apple's ARKit because of the its ease of use, affordability, stability and maturity as a platform and as an integrated system.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121054993","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An Interactive Demonstration of Collaborative VR for Laparoscopic Liver Surgery Training 协同VR在腹腔镜肝脏手术培训中的交互式演示

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00055

Vuthea Chheang, P. Saalfeld, T. Huber, F. Huettl, W. Kneist, B. Preim, C. Hansen

引用次数: 2

HoloLucination: A Framework for Live Augmented Reality Presentations Across Mobile Devices HoloLucination:一个跨移动设备的实时增强现实演示框架

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00053

A. Bahremand, Linda D. Nguyen, Tanya N. Harrison, R. Likamwa

{"title":"HoloLucination: A Framework for Live Augmented Reality Presentations Across Mobile Devices","authors":"A. Bahremand, Linda D. Nguyen, Tanya N. Harrison, R. Likamwa","doi":"10.1109/AIVR46125.2019.00053","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00053","url":null,"abstract":"We envision that in the future, presentations for business, education, and scientific dissemination can invoke 3D spatial content to immersively display and discuss animated 3-dimensional models and spatial data visualizations to large audiences. At the moment, current frameworks have targeted a highly technical user base, prohibiting the widespread curation of immersive presentations. Furthermore, solutions for real-time multi-user interactions have focused on multiplayer gaming, rather than large format immersive presentation. However, modern mobile devices (smartphones, tablets, headsets) have the capability of rendering virtual models over the physical environment through visual anchors for Augmented Reality (AR). Our ongoing research thrust is to leverage contemporary AR infrastructure to develop an easy-to use tool for users to curate and spatially present augmented presentations to large audiences. In this demo, we have built an Augmented Reality framework that allows users to curate mixed reality presentations. Our framework allows users to prepare a sequential state of animations. At the time of presentation, presenters can invoke the animations to simultaneously occur on HMDs and mobile devices.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133177997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

A Book Without Pages: Developing an Augmented Reality Storyteller Based on Open Web Data 一本没有书页的书:开发一个基于开放网络数据的增强现实故事讲述者

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00023

Panote Siriaraya, Takumi Kiriu, Yukiko Kawai, Shinsuke Nakajima

引用次数: 0

Using Visualization of Convolutional Neural Networks in Virtual Reality for Machine Learning Newcomers 机器学习新手在虚拟现实中使用卷积神经网络可视化

2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2019-12-01 DOI: 10.1109/AIVR46125.2019.00031

Nadine Meissler, Annika Wohlan, N. Hochgeschwender, A. Schreiber

引用次数: 13