Natalia Teixeira, Bianca Lahm, F. F. F. Peres, C. Mauricio, J. M. Teixeira
{"title":"Augmented Reality on Museums: the Ecomuseu Virtual Guide","authors":"Natalia Teixeira, Bianca Lahm, F. F. F. Peres, C. Mauricio, J. M. Teixeira","doi":"10.1145/3488162.3488219","DOIUrl":"https://doi.org/10.1145/3488162.3488219","url":null,"abstract":"Studies point that smartphones show an important role in the improvement of museum visitors experience. Mobile devices have become the main tool available for travellers, which enables the diffusion of augmented reality solutions through this channel. Based on that, a virtual guide prototype was developed to enhance the museum visitors experience inside a famous attraction from Foz do Iguaçu, the Ecomuseu, constructed with the objective to show the work of Itaipu’s hydroelectric power plant and the history regarding the region occupied by its reservoir. The developed application inserts virtual elements in different locations of the museum. Whenever such elements are “captured”, they tell the visitor information about what is being exhibited so the perception of the visitor and knowledge absorption can be improved. To validate the proposed solution, we tested the app with 15 different users. Due to the COVID-19 pandemic, we adapted the app and performed the evaluation over the virtual tour of the same museum, which is available online. For the sake of our knowledge, this is the first time an augmented reality application is evaluated over a virtual representation of a museum. Despite the difficulties imposed by the current context, the feedback from the tested users was very positive.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114209312","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Antonio Santos de Sousa, Rubens Fernandes Nunes, C. Vidal, J. B. C. Neto, Danilo Borges da Silva
{"title":"Physics-Based Motion Control Through DRL’s Reward Functions","authors":"Antonio Santos de Sousa, Rubens Fernandes Nunes, C. Vidal, J. B. C. Neto, Danilo Borges da Silva","doi":"10.1145/3488162.3488217","DOIUrl":"https://doi.org/10.1145/3488162.3488217","url":null,"abstract":"Producing natural physically-based motions of articulated characters is a challenging problem. The animator needs to figure out high-dimensional parameters of a motion controller to get good visual quality, while still having to deal with the basic functioning of the controller. However, those parameters generally have an unintuitive relationship with the resulting motion. Deep Reinforcement Learning (DRL) has been recently explored to solve such problem. With DRL, it is possible to set a neural network with observation and action parameters and control the animation through a reward function. Nevertheless, choosing good parameters and a reward function is not a simple task. In this paper, we investigate how the animator can control the motion by manipulating simple reward functions. We propose a control structure with DRL, in which the reward function can be adapted to the desired motion and to the morphology of the controlled character. Moreover, we introduce speed in the training process so that, after training the neural network, the character is able to adapt its motion to different speeds in real time. Through a series of tests, we assess animation and speed controls of characters with different morphologies.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"47 12","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114109219","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Estimating the Pose of a Medical Manikin for Haptic Augmentation of a Virtual Patient in Mixed Reality Training","authors":"D. Scherfgen, Jonas Schild","doi":"10.1145/3488162.3488166","DOIUrl":"https://doi.org/10.1145/3488162.3488166","url":null,"abstract":"Virtual medical emergency training provides complex while safe interactions with virtual patients. Classical non-virtual medical training includes the use of medical manikins. Haptically integrating such a manikin into virtual training has the potential to improve the interaction with a virtual patient (e.g. regarding social presence) and the resulting training experience. This work analyzes user requirements and several technological approaches. The presented system estimates the pose of a medical manikin in order to haptically augment a 3D human model in a virtual reality (VR) training environment, allowing users to physically touch a virtual patient. The system uses a Convolutional Neural Networks-based (CNN) body keypoint detector to locate relevant keypoints of the manikin in the images of the stereo camera built into a head-mounted display (HMD). The system retrieves manikin position, orientation and joint angles using non-linear optimization. A manual precision analysis reports a mean error distance of 48 mm. Unless further optimized, we recommend applying this method for haptically augmented social interaction with virtual patients but not for practicing precise medical treatments.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127533839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Virtual Reality in Radiology: A Systematic Mapping Study","authors":"Renan Trevia, M. Pinho","doi":"10.1145/3488162.3488224","DOIUrl":"https://doi.org/10.1145/3488162.3488224","url":null,"abstract":"In radiology, virtual reality has emerged as a candidate to solve some issues of the area, such as the ambient lighting and ergonomic postures when diagnosing. The goal of this study is to explore the literature of virtual reality in radiology in order to define and describe the state-of-the-art in addition to finding gaps and opportunities for future research. To do so, we carried out a systematic mapping study covering the period from January 2014 to July 2021. We initially found 329 papers to be reviewed, but after applying our exclusion criteria we ended up with 24 primary studies. Our results suggest that the use of virtual reality has grown recently in the field, however there are many gaps and opportunities to explore in the area.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130026857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Franklin Giovani Bastidas Cuya, R. Guarese, C. G. Johansson, Maria-Paz Giambastiani, Yhonatan Iquiapaza, Victor Adriel de Jesus Oliveira, L. Nedel, Anderson Maciel
{"title":"Vibrotactile Data Physicalization: Exploratory Insights for Haptization of Low-resolution Images","authors":"Franklin Giovani Bastidas Cuya, R. Guarese, C. G. Johansson, Maria-Paz Giambastiani, Yhonatan Iquiapaza, Victor Adriel de Jesus Oliveira, L. Nedel, Anderson Maciel","doi":"10.1145/3488162.3488171","DOIUrl":"https://doi.org/10.1145/3488162.3488171","url":null,"abstract":"We present a visuo-haptic interaction approach that augments the visual experience of graphic data visualization with meaningful vibrotactile information. The user of our interface explores charts and graphs on a conventional video monitor or other displays, e.g. projection, or printed paper. When a user touches the data visualization, an array of vibrotactile actuators placed at the joints on the back of their hand modulates frequency and amplitude to build signals that convey information, in a process of dynamic physicalization. We investigated the haptic perception of the method based on the change in the intensity of the simultaneous vibration and the distance between two variables being analyzed. For this, we assess a prototype of our interface in a user study (N=25) to understand how the stimulus is perceived and understood. Results show that different vibration intensities are recognized regardless of the spatial distance between them. The statistically significant difference in precision and response time between two values being haptically displayed shows it is possible to discriminate pieces of data with a faster response time as the percentage difference in intensity between them increases. Additionally, a heat map of the user interaction with the data represented by a square area shows that the user seeks to feel a single rendered data value on all actuators in the hand at once, rather than having two values rendered simultaneously on different fingers of the same hand.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"104 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121070142","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yuri Fernando Tiecher Sefrin, C. Mauricio, F. F. F. Peres
{"title":"Usability Evaluation of a 3D Digital-TwinIndirect usability evaluation of SOMA – System Oriented to Monitoring of Engineering Assets","authors":"Yuri Fernando Tiecher Sefrin, C. Mauricio, F. F. F. Peres","doi":"10.1145/3488162.3488220","DOIUrl":"https://doi.org/10.1145/3488162.3488220","url":null,"abstract":"The evaluation of software usability is a very important topic for society. Usability depends on factors intrinsic to the task to be performed. In hydroelectric plants, the main task to be performed by operators is the analysis and monitoring of the sensors of the generating unit. The hypothesis is that the use of a 3D interface brings more usability and efficiency to find the sensors. The work applies Nielsen’s heuristics to ensure good usability. This work intends to evaluate the usability of SOMA – System Oriented to Monitoring of Engineering Assets, a software that monitor Hydroelectric Power Plant, operation of electricity generation plants, in terms of increasing availability and reducing maintenance costs. The results of this indirect usability evaluation were positive, suggesting new features to the software to help engineers to perform even better their tasks on monitoring assets.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126694399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Alves, A. Uribe-Quevedo, Delun Chen, Jon Morris, Sina Radmard
{"title":"Leveraging Simulation and Virtual Reality for a Long Term Care Facility Service Robot During COVID-19","authors":"S. Alves, A. Uribe-Quevedo, Delun Chen, Jon Morris, Sina Radmard","doi":"10.1145/3488162.3488185","DOIUrl":"https://doi.org/10.1145/3488162.3488185","url":null,"abstract":"Providing care to seniors and adults with Developmental Disabilities (DD) presents challenges associated with care, companionship, medication intake, and fall monitoring among others. Currently, measures to prevent the spread of COVID-19 have seen restricted access to those living in long-term care facilities (LTCFs). While technologies such as robotics and virtual reality (VR) have seen advances in overcoming the aforementioned challenges, the restrictions have impacted research and development relying on human participants. Recently, the use of synthetic data for training motion detection algorithms and virtual worlds has been gaining momentum as an alternative continue for simulating robot and human interactions instead of relying on public databases and physical locations. Here, we propose the development of VR robot simulator for Aether™, a socially assistive mobile robot created to help seniors and people living with DD to achieve a higher degree of independence. For example, Aether™can assist caregivers by alleviating the burden of care by monitoring the LTCF for tripping hazards, open doors and cabinets. Our simulator allows configuring the virtual Aether™robot to navigate a virtual environment and detect upper limb gestures performed by a virtual avatar. Our preliminary results indicate that the virtual sensor has detection equivalent to the real sensor, thus ensuring that the simulated data is transferable for real-world testing.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127404406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Comparison of machine learning algorithms for automatic assessment of performance in a virtual reality dental simulator","authors":"L. H. Sallaberry, R. Tori, Fátima L. S. Nunes","doi":"10.1145/3488162.3488207","DOIUrl":"https://doi.org/10.1145/3488162.3488207","url":null,"abstract":"Virtual reality simulators for training of apprentices have been successfully developed for many different medical fields. However, establishing an objective and automatic method to assess the student’s performance is still difficult to achieve, as it is fairly complex to model and it can differ significantly for each medical procedure. In this study, we extracted several features from a dataset collected in a virtual reality simulator and compared the performance of different machine learning classification algorithms (Naive Bayes, Random Forests, Multi Layer Perceptrons and Support Vector Machine) and feature select/fusion algorithms (ReliefF and PCA). We found that the Naive Bayes classifier generally achieved worse results than the other three classifiers and the best results for each algorithm was usually achieved when combined with the ReliefF feature selection algorithm.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134056920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kody Wood, A. Uribe-Quevedo, Lina Peñuela, Sharman Perera, B. Kapralos
{"title":"Virtual Reality Assessment and Customization Using Physiological Measures: A Literature Analysis","authors":"Kody Wood, A. Uribe-Quevedo, Lina Peñuela, Sharman Perera, B. Kapralos","doi":"10.1145/3488162.3488228","DOIUrl":"https://doi.org/10.1145/3488162.3488228","url":null,"abstract":"Understanding the user experience requires gathering self-reported and physiological information. In Virtual Reality (VR), heart rate, skin responses, gaze, brain, and muscle activity can provide a better understanding of how users process perceptual cues and respond to them. While the use of physiological measures is typically done for the assessment and improvement of the user experience, recent trends have shown their application for customizing VR experiences to the unique responses of the users. The purpose of this literature review is to analyze the use of physiological measures in VR customization to identify the state of the art, gaps, and opportunities. A total of 25 articles from indexed journals found in Scopus, PubMed, Web of Science, and IEEE, in addition to top tier conferences such as IEEE VR and CHI within the last five years were reviewed. The review indicates that while assessment continues to be a main field of application of physiological measures, the recent availability of consumer-level VR and the growth of ubiquitous physiological sensors are enabling their use as user input devices for customized and adaptive user experiences.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125307692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gabriel Sierra Picon, Carlos Alberto Rocha Castano, Wilson J. Sarmiento
{"title":"Non-Traditional Rig for Virtual Environment Systems. Case study: Arm rig","authors":"Gabriel Sierra Picon, Carlos Alberto Rocha Castano, Wilson J. Sarmiento","doi":"10.1145/3488162.3488230","DOIUrl":"https://doi.org/10.1145/3488162.3488230","url":null,"abstract":"This paper presents a case study of non-traditional skeleton rigs to solve candy wrapper problems in Virtual Environment systems. The approach tested is an alternative to traditional skeleton rigs used in animation processes, which may generate undesirable deformations in the mesh since they are usually made with handcrafted artistic animation in mind. In Virtual Environment systems, manual improving limbs’ mesh deformation is not possible. This work includes promissory results in the naturalness of the deformation of the wrist of a digital character, validated with eight experts’ subjective evaluations in 3D production.","PeriodicalId":193769,"journal":{"name":"Symposium on Virtual and Augmented Reality","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114711802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}