{"title":"Projection Mapping Method Using Projector-LiDAR (light detection and ranging) Calibration","authors":"Dayeon Yoon, Jinyoung Kim, Jayang Jo, Kibum Kim","doi":"10.1109/VRW58643.2023.00271","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00271","url":null,"abstract":"The projector-LiDAR system performs projection mapping on a long-distance object after calibrating the projector using LiDAR. With LiDAR equipped with an RGB camera, users can calibrate the projector in just two scans. Because this system knows the ray formula for every pixel shooting from the projector, it can make accurate projections. In particular, the system introduces how to perform linear interpolation in the process of obtaining a formula and a methodology that allows users to immediately know the 3D coordinates of a desired part in a 2D image. Through a long-distance experiment, the projection mapping result of the proposed method showed an error of less than 5mm, and the existing system had a maximum error of 30mm.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126401714","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Phyllis Oduor, Luqman Mushila, Doris Cheta, Lucy Kageha, Bruce Daniel, Lydiah Nyachiro, Dinah Okwiri, S. Ogana, Thomas Ng'abwa, Jarrett Rosenberg, J. Arudo, Tecla Sum, Christoph Leuze
{"title":"Augmented Reality for Medical Training in Eastern Africa","authors":"Phyllis Oduor, Luqman Mushila, Doris Cheta, Lucy Kageha, Bruce Daniel, Lydiah Nyachiro, Dinah Okwiri, S. Ogana, Thomas Ng'abwa, Jarrett Rosenberg, J. Arudo, Tecla Sum, Christoph Leuze","doi":"10.1109/VRW58643.2023.00288","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00288","url":null,"abstract":"Access to qualified medical care is severely limited in low-resource areas within East Africa. Technologies like Augmented Reality (AR) have been shown to be useful for medical teaching and guidance and may contribute to the training of medical experts in these countries. While still expensive, AR has low infrastructure requirements like cell phones, where ownership has constantly increased over the last few years. However, AR is mainly tested for training and surgical applications in highly developed environments. In this study, we tested whether AR can also address the needs for healthcare and medical education in East Africa. Our study consisted of a medical need-finding part and a pilot study to address some of these needs with AR. Our study shows that remote teaching via AR led to significantly higher test score gains and more consistent results than in the in-person control group.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121104940","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Carlos J. Latorre-Rojas, Alexander Rozo-Torres, Wilson J. Sarmiento
{"title":"Interaction models for surgical planning in eXtended Reality. Challenges in radiologist-surgeon communication","authors":"Carlos J. Latorre-Rojas, Alexander Rozo-Torres, Wilson J. Sarmiento","doi":"10.1109/VRW58643.2023.00036","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00036","url":null,"abstract":"Extended Reality (XR) technologies have been included in medical applications, showing benefits for patient well-being. For medical image visualization, XR offers promising benefits but also design and evaluation challenges. In this preliminary work, direct observations and interviews were conducted with two expert health workers (one surgeon and one radiologist) who used an XR technology to perform immersive anatomic visualization for surgical planning for two years. Interaction requirements and expectations were collected, which provided a basis for the position that communication during surgical planning improves if the virtual environment offers interaction models for both medical specialties. Subsequently, a technical review of medical image visualization software in PC and XR platforms was carried out to analyze the interaction techniques provided to the users. Finally, interaction models were conceived to offset the lack of interaction techniques oriented to the surgeon's needs.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"7 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120996741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yang Gao, Hongming Bai, Ziyi Pei, Wenfeng Song, Aimin Hao
{"title":"VR-based Vector Watercolor Painting System","authors":"Yang Gao, Hongming Bai, Ziyi Pei, Wenfeng Song, Aimin Hao","doi":"10.1109/VRW58643.2023.00189","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00189","url":null,"abstract":"We develope a VR-based watercolor painting system. The system generates paintings in the form of vector graphics, which remain clear under free scaling and panoramic projection in VR space. Meanwhile, in order to create a better operation experience and more convenient user interaction in the VR environment, we optimize the system to enable a variety of realistic watercolor effects and provide users with a number of optional painting settings such as color, size, effect, etc. After a short period of study, users can easily use the system to complete the VR painting experience.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121031297","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"IPS: Integrating Pose with Speech for enhancement of body pose estimation in VR remote collaboration","authors":"Seoyoung Kang, S. Jeon, Woontack Woo","doi":"10.1109/VRW58643.2023.00161","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00161","url":null,"abstract":"We propose a Speech-Pose integration method to overcome the limitation of existing body pose estimation. Unlike previous Speech-based gesture generation method, our proposal reflects the user's actual pose using a vision-based system and speech as a subsidiary. When the system detects the camera out of sight, we carry out a context-aware method analyzing the speech. The system determines the target pose and connects it with the last pose captured by the camera using the bounding box. Our system can be a robust solution for avatar-mediated remote collaboration which requires accurate gesture delivery such as VR remote yoga training.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125123175","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"UPSR: a Unified Proxy Skeleton Retargeting Method for Heterogeneous Avatar Animation","authors":"Wenfeng Song, Xinyu Zhang, Yang Gao, Yi-Xiao Luo, Haoxiang Wang, Xianfei Wang, X. Hou","doi":"10.1109/VRW58643.2023.00276","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00276","url":null,"abstract":"Pose-driven avatar animation is widely applied in VR fields. The flexible creation of animations is a significant yet challenging task due to the heterogeneous topologies and shapes of avatars. To allevi-ate this, we propose a unified proxy skeleton for retargeting (UPSR) to achieve consistent motions of the virtual avatar. Particularly, the heterogeneous topologies are converted into a unified skeleton topol-ogy of the avatars by using a learned nonlinear mapping function. Furthermore, we propose to retarget the skeletons with different body shapes into 3D virtual avatars. Our UPSR can produce avatar animations with a higher level of authenticity without the depen-dency on high-cost motion capture devices or the restrictions of its topology. Additionally, we could drive detailed motions based on multiple sources of motion datasets, including monocular videos, motion capture devices, and standard motion files, with the precise motion capture of eyes, lips, hands, and bodies.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122406102","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"IEEE VR 2023 Workshops","authors":"Yuyang Wang, J. Chardonnet, Lik-Hang Lee, Pan Hui","doi":"10.1109/VRW58643.2023.00019","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00019","url":null,"abstract":"The 2nd workshop on Datasets for Developing Intelligent XR Applications (DATA4XR) aims to address the challenges of public datasets and reproducibility in Extended Reality, also known as XR (Augmented Reality, Virtual Reality, and Mixed Reality) research. The workshop brings together experts to discuss the availability, privacy concerns, and ethics related to open-sourcing the datasets used in XR research for algorithm training and user behavior analysis. By examining the ethical, moral, and privacy concerns","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131227141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cinematography in the Metaverse: Exploring the Lighting Education on a Soundstage","authors":"Xian Xu, Wai Tong, Zheng Wei, Meng Xia, Lik-Hang Lee, Huamin Qu","doi":"10.1109/VRW58643.2023.00128","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00128","url":null,"abstract":"Lighting education is a foundational component of cinematography education. However, there is still a lack of knowledge on the design of a VR system for teaching cinematography. In this work, we present our VR soundstage system for instructors and learners to emulate cinematography lighting in virtual scenarios and then evaluate it from five aspects in the user study. Qualitative and quantitative feedback in our user study shows promising results. We further discuss the benefits of the approach and opportunities for future research.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121764011","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cross-Reality for Extending the Metaverse: Designing Hyper-Connected Immersive Environments with XRI","authors":"Jie Guan, Alexis Morris, Jay Irizawa","doi":"10.1109/VRW58643.2023.00071","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00071","url":null,"abstract":"The Metaverse comprises technologies to enable virtual twins of the real world, via mixed reality, internet of things, and others. As it matures unique challenges arise such as a lack of strong connections between virtual and physical worlds. This work presents design frameworks for cross-reality hybrid spaces. Contributions include: i) clarifying the metaverse “disconnect”, ii) extended metaverse design frameworks, iii) prototypes, and iv) discussions toward new metaverse smart environments.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"120 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121856110","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Graph-based Error Correction Model Using Lie-algebraic Cohomology and Its Application on Global Consistent Indoor Scene Reconstruction","authors":"Yuxue Ren, Baowei Jiang, Wei Chen, Na Lei, X. Gu","doi":"10.1109/VRW58643.2023.00277","DOIUrl":"https://doi.org/10.1109/VRW58643.2023.00277","url":null,"abstract":"We present a novel, effective method for global indoor scene reconstruction problems by geometric topology. Based on point cloud pairwise registration methods (e.g ICP) or IMU, we focus on the problem of accumulated error for the composition of transformations along any loops. The major technical contribution of this paper is a linear method for the graph optimation, using only solving a Poisson equation. We demonstrate the consistency of our method from Hodge-Helmhotz decomposition theorem and experiments on multiple RGBD datasets of indoor scene. The experimental results also demonstrate that our global registration method runs quickly and provides accurate reconstructions.","PeriodicalId":412598,"journal":{"name":"2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128108742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}