Christian Schönauer, H. Kaufmann, M. Roussou, Julien Rüggeberg, Jim Rüggeberg, Lucas Katsikaris, Sakis Rogkas, D. Christopoulos
{"title":"Creating Informal Learning and First Responder Training XR Experiences with the ImmersiveDeck","authors":"Christian Schönauer, H. Kaufmann, M. Roussou, Julien Rüggeberg, Jim Rüggeberg, Lucas Katsikaris, Sakis Rogkas, D. Christopoulos","doi":"10.1109/VRW58643.2023.00016","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00016","url":null,"abstract":"In recent years eXtended Reality (XR) technologies have matured and have become affordable, yet creating XR experiences for training and learning in many cases is still a time-consuming and costly process, hindering widespread adoption. One factor driving effort is that content and features commonly required by many applications get re-implemented for each experience, instead of sharing and reusing these resources by means of a common platform. In this paper we present two XR experiences in the context of informal learning and first responder training along with the shared platform they have been created with and the creation process. Furthermore, we have technically evaluated relevant parts of the platform for feasibility of use with experience requirements and confirmed ap-plicability. Finally, we present an informal expert evaluation of the content creation process's user experience for the informal learning experience along with guidelines derived from the findings.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128875410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Motion Analysis and Reconstruction of Human Joint Regions for Sparse RGBD Images","authors":"T. Dong, Yuntao Bai, Qing Zhang, Yi Zhang","doi":"10.1109/VRW58643.2023.00229","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00229","url":null,"abstract":"We propose a motion deformation analysis framework that can re-construct the joint region of dynamic human only depending on extremely sparse RGBD images. In the framework, we analyze the deformation mechanism of the joint region from the perspective of its internal material. The non-rigid deformation of a joint region is transformed into the elastic deformation of multiple elements by introducing Finite Element Method. Considering the influence of joint position on the motion deformation analysis, we optimize the joint positions obtained from skeleton tracking prior. Experimental results verify the rationality and effectiveness of our framework.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121971035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Investigating Interaction Behaviors of Learners in VR Learning Environment","authors":"Antony Prakash, Danish Shafi Shaikh, R. Rajendran","doi":"10.1109/VRW58643.2023.00308","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00308","url":null,"abstract":"The education researchers use self-reported questionnaires, physiological sensors, and human observers to study the effects of VR in education. The above-mentioned existing data collection mechanisms do not provide information related to the interaction behavior of the learners in VR Learning Environments (VRLE). As a result, understanding the learning processes from the perspective of learners' behavior in VRLE is still in its infancy. Hence, we developed a mechanism that is able to automatically log all the interaction behavior of the learners happening in VRLE along with timestamps. In this paper, we discuss the study conducted with 14 undergraduate engineering students after deploying the developed real-time Interaction Behavioral Data (IBD) collection mechanism in a room-scale VRLE, Maroon VR. The IBD collected will be analyzed to understand the VR behavior of the learners and the learning processes happening in VRLE. The results of the study could be further utilized to model the learners' behavior in VR and to provide adaptive personalized VR learning content.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116401973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Case Study of a Computational Model for Immersive Human-Process Interactions within Design Optimization","authors":"D. Guzzetti","doi":"10.1109/VRW58643.2023.00166","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00166","url":null,"abstract":"Virtual reality enables incorporating new cues and affordances into design optimization interfaces. Designers visually interact with optimization algorithms to examine solutions, define the search space, and present tradeoffs or outcomes. We hypothesize that additional dimensions of the human-process interface yield a higher probability of discovering the global optimal solution. To test this hypothesis, this work develops a computational model for visual-based process interactions in design optimization. The model is inspired by the Van Wijk model for visual analytics. Initial numerical results support the hypothesis.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125338763","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Maximilian Rettinger, Sebastian Berndt, G. Rigoll, Christoph Schmaderer
{"title":"Collaborative VR: Conveying a Complex Disease and Its Treatment","authors":"Maximilian Rettinger, Sebastian Berndt, G. Rigoll, Christoph Schmaderer","doi":"10.1109/VRW58643.2023.00133","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00133","url":null,"abstract":"In medical research, there are constantly new findings that lead to new insights and novel treatments. Hence, physicians always need to stay up-to-date to provide high-quality patient care. Virtual reality is unique among the available learning methods as it offers the opportunity to collaboratively explore the inside of the human body to experience and understand the complex workings of medical interventions. We realized such a VR-Learning-System and assessed its potential with medical experts (n = 9). Initial results indicate that experts prefer the new system, and according to their subjective assessment, they achieved a higher learning outcome compared to conventional methods.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"99 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123771202","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bingqing Shen, Xirui Xiong, Han Yu, Pan Hu, Lihong Jiang, Hongming Cai
{"title":"Online Interactive Simulation with Digital Twins for Collaborative Manufacturing","authors":"Bingqing Shen, Xirui Xiong, Han Yu, Pan Hu, Lihong Jiang, Hongming Cai","doi":"10.1109/VRW58643.2023.00100","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00100","url":null,"abstract":"The emerging information technologies are leading the new generation of industrial revolution. The manufacturing industry is benefited by the combination of cybernetic and physical systems. To facilitate decision-making, digital twins can reflect production realities to human/intelligent agents. But, it is not sufficient to support manufacturing in highly complex manufacturing environments. For this purpose, we proposed a new digital twin-based manufacturing paradigm and an online interactive simulation framework, which can provide both diagnostic and prognostic support. Moreover, we introduced an implementation approach and realized a prototype system. By comparing with existing smart manufacturing systems, our design can better support production decision-making. Thus, this work takes the first step to achieve smarter manufacturing.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124024010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Immersive Visualization Lab at Idaho National Laboratory","authors":"Rajiv Khadka, John M. Koudelka","doi":"10.1109/VRW58643.2023.00055","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00055","url":null,"abstract":"This article introduces the Applied Visualization Laboratory at Idaho National Laboratory, including the lab's success and challenges as an immersive visualization laboratory. Also, it discusses the future direction of the immersive virtual environment and visualization.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127924371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Table2Table: Merging “Similar” Workspaces and Supporting Adaptive Telepresence Demonstration Guidance","authors":"Heeyoon Jeong, G. Kim","doi":"10.1109/VRW58643.2023.00088","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00088","url":null,"abstract":"In a typical tele-presence system, the remote participant is “trans-ported” into the local space to be shared. However, such a set-up limits the remote participant in terms of physical interaction and demonstration with the objects in the local space. One alternative is to merge the two spaces, such that the student in one space can closely watch and mimic the actions of the instructor in its space - as often occurs in science laboratories or cooking classes. As the local set-ups in the two spaces may not be exactly the same, the student has to “adapt” to the situation and identify the right objects in mimicking the instructor. We propose to semi-automatically iden-tify such object mappings, and based on the mapping, recognize the instructor's action, and replicate it in the student's space. Our preliminary user testing showed the possibility of the framework in improving the communication and process of learning.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127993262","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Attention-Based Signed Distance Field Estimation Method for Hand-Object Reconstruction","authors":"Xinkang Zhang, Xinhan Di, Xiaokun Dai, Xinrong Chen","doi":"10.1109/VRW58643.2023.00180","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00180","url":null,"abstract":"Joint reconstruction of hands and objects from monocular RGB images is a challenging task. In this work, we present a novel hybrid model for joint reconstruction of hands and objects. The model proposed consists of three key modules. Among them, multi-scale attention feature extractor is designed to enhance cross-scale in-formation extraction. Attention-based graph encoder can encode the graph information of the hands. Interacting attention module is applied to fuse information between hands and object. Test re-sults on ObMan dataset [6] show that our method outperforms the state-of-the-art method around 13.97% and 15.75% in $mathrm{H}_{text{se}}$ and $mathrm{H}_{text{je}}$ respectively.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127430163","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Space Topology Change Mostly Attracts Human Attention: An Implicit Feedback VR Driving System","authors":"Tingting Li, Fanyu Wang, Zhenping Xie","doi":"10.1109/VRW58643.2023.00269","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00269","url":null,"abstract":"Driving safety, especially for autonomous vehicles, is severely chal-lenged by unexpected object motions. To investigate the internal mechanism of how human vision can instantly and robustly respond to those sudden changes, a novel implicit feedback VR driving sys-tem is designed. Wherein, the object-level and space-level topologi-cal properties for scene changes are introduced, and the simulated driving scenes are constructed in VR environment with EEG signals and eye-tracking feedback. The experimental results demonstrate that, space-level topology changes mostly attract human visual attention among the space-level, object-level and non-topology changes. Obviously, the results inform a very solid theoretical foundation for developing safer assisted even autonomous driving systems.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"158 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129030156","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}