{"title":"Video Demo: Unsupervised Learning of Depth and Ego-Motion from Cylindrical Panoramic Video","authors":"Alisha Sharma, Jonathan Ventura","doi":"10.1109/AIVR46125.2019.00059","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00059","url":null,"abstract":"In this demonstration, we will present a video showing depth predictions for street-level 360° panoramic footage generated using our unsupervised learning model. Panoramic depth estimation is important for a range of applications in- cluding virtual reality, 3D modeling, and autonomous robotic navigation. We have developed a convolutional neural network (CNN) model for unsupervised learning of depth and ego-motion from cylindrical panoramic video. In contrast with previous works, we focus on cylindrical panoramic projection. Unlike spherical or cube map projection, cylindrical projection is fully compatible with traditional CNN layers while still supporting a continuous 360° horizontal field of view. We find that this increased field of view improves the ego-motion prediction accuracy for street-level video input. This abstract motivates our work in unsupervised structure-from-motion estimation, describes the video demonstration, outlines our implementation, and summarizes our study conclusions.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"82 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132766536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nadine Meissler, Annika Wohlan, N. Hochgeschwender, A. Schreiber
{"title":"Explore Convolutional Neural Networks in Virtual Reality","authors":"Nadine Meissler, Annika Wohlan, N. Hochgeschwender, A. Schreiber","doi":"10.1109/AIVR46125.2019.00056","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00056","url":null,"abstract":"We visualize the functionality of Convolutional Neural Networks (CNN) in Virtual Reality to help newcomers understand the general functioning of these algorithms. Our interactive visualization allows users to explore CNNs layer by layer.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126244646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Kinematically Adaptive Exergames: Personalizing Exercise Therapy Through Closed-Loop Systems","authors":"J. Muñoz, Shi Cao, J. Boger","doi":"10.1109/AIVR46125.2019.00026","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00026","url":null,"abstract":"Exergaming research has identified the potential of using game elements as part of a training routine for exercise promotion. The high levels of motivation provided by Exergames as well as the reduced costs of modern interactive technologies have allowed a more extended adoption of this technology. Nevertheless, personalization is still a big issue since it is a key factor to improve Exergaming effectiveness. This paper contemplates the theoretical and practical notions of a kinematically adaptive framework for Exergames that uses off-the-shelf motion trackers to collect kinematic data during gameplay and creates real-time adaptations based on specific movement patterns. The framework consists of three modules for data collection, analysis, and translation that work together in a closed-loop system capable of adapting the motor behavior of players to desirable states via providing timely feedback and modulations of game parameters during training sessions. We discuss the importance of the kinematically adaptive framework in the Exergaming field and propose methodologies for its implementation.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126804735","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
W. Santos, Isabela Chambers, E. V. Brazil, M. Moreno
{"title":"Drafting Interpretation of Seismic Data through Virtual Reality with Hyperknowledge Base Systems","authors":"W. Santos, Isabela Chambers, E. V. Brazil, M. Moreno","doi":"10.1109/AIVR46125.2019.00051","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00051","url":null,"abstract":"Seismic data are sources of information used by geophysics and geologist to infer the lithology of a region and look for evidence of possible hydrocarbon deposits. The interpretation of this data is critical for natural resources exploration in the business of industries like oil&gas. However, the essence of the data is volumetric, and the interpretation is challenging and time-consuming even for skilled domain specialists. In this work, we present a virtual reality system to explore seismic data assisted by a knowledge base and AI services. We focus on the aspect of visualizing and creating 3D annotations that are artifacts that highlight regions of interest that will characterize structures of the seismic data. A hybrid knowledge base (Hyperknowledge base), which support multimodal data, plays the role to integrate all those annotations from user to AI services and vice-versa. Hence, users shall use the system for decision making in immersive environments that preserve the volumetric perspective of the data for a better understanding of them.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127939268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"[Copyright notice]","authors":"","doi":"10.1109/aivr46125.2019.00003","DOIUrl":"https://doi.org/10.1109/aivr46125.2019.00003","url":null,"abstract":"","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130132245","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"DroneVR: A Web Virtual Reality Simulator for Drone Operator","authors":"V. Nguyen, Kwanghee Jung, Tommy Dang","doi":"10.1109/AIVR46125.2019.00060","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00060","url":null,"abstract":"In recent years, Unmanned Aerial Vehicle (UAV) has been used extensively in various applications from entertainment, virtual tourism to construction, mining, agriculture. Navigation, path planning, and image acquisition are the main tasks in administering these aerial devices in accordance with real-time object tracking for affordable aerial vehicles. Aircraft crash is one of the most critical issues due to the uncontrolled environment and signal loss that cause the aerial vehicle to hit the buildings on its returning mode. Furthermore, real-time image processing, such as object tracking, has not yet been exploited for a low-cost aerial vehicle. This paper proposes a prototype embedded in a Web-based application called DroneVR to mitigate the aforementioned issues. The virtual reality environment was reconstructed based on the real-world fly data (OpenStreetMap) in which path planning and navigation were carried out. Gaussian Mixture Model was used to extract foreground and detect a moving object, Kalman Filter method was then applied to predict and keep track of object's motion. Perceived ease of use was investigated with a small sample size users to improve the simulator.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"95 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130503938","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Extending Socio-Technological Reality for Ethics in Artificial Intelligent Systems","authors":"Nadisha-Marie Aliman, L. Kester","doi":"10.1109/AIVR46125.2019.00064","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00064","url":null,"abstract":"Due to significant technological advances leading to an expansion of the possible solution space of more or less autonomously operating artificial intelligent systems in real-world environments, society faces the challenge to specify the goals of these systems while jointly covering ethical conceptions and legal frameworks. In this paper, we postulate that for this complex task of societal relevance pertaining to both AI Ethics and AI Safety, Virtual Reality (VR) and also Augmented Reality (AR) represent valuable tools whose utilization facilitates the extension of socio-technological reality by offering a rich counterfactual experiential testbed for enhanced ethical decision-making. For this purpose, we use the example of autonomous vehicles (AVs) to elaborate on how VR and AR could provide a twofold structured augmentation for the governance of artificial intelligent systems by enhancing society with regard to ethical self-assessment and ethical debiasing. Thereby, we extend existing literature by tailored recommendations based on insights from cognitive neuroscience and psychology to solve inconclusive open issues related to past VR experiments involving ethically relevant dilemmas in AV contexts. Finally, we comment on possible VR/AR-based cognitive-affective augmentation measures for a transformative impact on future AI Ethics and AI Safety endeavors.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"81 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134351855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Vuthea Chheang, P. Saalfeld, T. Huber, F. Huettl, W. Kneist, B. Preim, C. Hansen
{"title":"Collaborative Virtual Reality for Laparoscopic Liver Surgery Training","authors":"Vuthea Chheang, P. Saalfeld, T. Huber, F. Huettl, W. Kneist, B. Preim, C. Hansen","doi":"10.1109/AIVR46125.2019.00011","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00011","url":null,"abstract":"Virtual reality (VR) has been used in many medical training systems for surgical procedures. However, the current systems are limited due to inadequate interactions, restricted possibilities of patient data visualization, and collaboration. We propose a collaborative VR system for laparoscopic liver surgical planning and simulation. Medical image data is used for model visualization and manipulation. Additionally, laparoscopic surgical joysticks are used to provide an opportunity for a camera assistant to cooperate with an experienced surgeon in VR. Continuous clinical feedback led us to optimize the visualization, synchronization, and interactions of the system. Laparoscopic surgeons were positive about the systems' usefulness, usability, and system performance. Additionally, limitations and potential for further development are discussed.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131602234","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Robert Miller, A. Ajit, N. Banerjee, Sean Banerjee
{"title":"Realtime Behavior-Based Continual Authentication of Users in Virtual Reality Environments","authors":"Robert Miller, A. Ajit, N. Banerjee, Sean Banerjee","doi":"10.1109/AIVR46125.2019.00058","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00058","url":null,"abstract":"In this work, we present a realtime interactive system that uses the trajectories of the device controllers and headset of a virtual reality (VR) system to perform continual authentication of users interacting in VR. Our system identifies a user within .21 +/- .04 seconds of provision of a trajectory for a ball-throwing application. Given an interaction session authorized for a user within an organization, our system continually authenticates the current user by computing matches for the positions and orientations of the points on trajectories of the right hand controller, left hand controller, and headset for the user against controller and headset trajectories in a library of users. The system combines the position and orientation matches using a neural network pre-trained to predict confidences on matches computed within the library, and provides a speech interface to output the identified user as the library user with the maximum value of predicted confidence. The system uses the identity of the user authorized to use a session and a confidence threshold to detect if the user is genuine, a malicious user internal to the organization, or an external intruder. Our system can be readily ported into virtual reality applications that require realtime behavioral authentication of users for secure access.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132532758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Creating an Immersed Sheep and Wool VR/AI Experience","authors":"Helen X. Trejo","doi":"10.1109/AIVR46125.2019.00050","DOIUrl":"https://doi.org/10.1109/AIVR46125.2019.00050","url":null,"abstract":"The development of a sheep and wool conservancy initiative, \"Shave 'em to Save 'em,\" inspired the creation of a Virtual Reality/ Artificial Intelligence game \"For Ewe,\" a proof-of-concept game. It aims to support agricultural and sustainable design initiatives. The game development process was guided by Activity Theory and was created using Unity 3D. \"For Ewe\" was tested on web, Samsung Gear VR, and Oculus Quest virtual reality platforms.","PeriodicalId":274566,"journal":{"name":"2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"85 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121151922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}