Mark Armstrong, Kinga Skiers, Danyang Peng, Tamil Selvan Gunasekaran, Anish Kundu, Tanner Person, Yixin Wang, K. Minamizawa, Yun Suen Pai
{"title":"Heightened Empathy: A Multi-user Interactive Experience in a Bioresponsive Virtual Reality","authors":"Mark Armstrong, Kinga Skiers, Danyang Peng, Tamil Selvan Gunasekaran, Anish Kundu, Tanner Person, Yixin Wang, K. Minamizawa, Yun Suen Pai","doi":"10.1145/3588027.3595599","DOIUrl":"https://doi.org/10.1145/3588027.3595599","url":null,"abstract":"We present Heightened Empathy, a multi-user interactive experience in bioresponsive virtual reality (VR) designed to visualize emotional states and stimulate different types of empathy between two players in various interactive modes. The experience immerses users in a VR representation of each other’s emotional state, while also reflecting this to the audience using a table-top social robot and projection as they interact with each other. In competitive mode, the goal is to promote cognitive empathy where each user needs to understand the new emotional representation in VR to win. In communication mode, we have users act on one another verbally to promote emotional empathy. The experience aims to enhance empathy perception by placing the players in virtual environments that require them to understand, share, and act on each other’s perspectives and emotions.","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131157177","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Mixed Design in Reality: How to translate a VR Game to a MR World and What’s some design issues about it?","authors":"Marcelo Nery, Kako D'Angello","doi":"10.1145/3588027.3595604","DOIUrl":"https://doi.org/10.1145/3588027.3595604","url":null,"abstract":"Adapting a VR game to MR posed challenges in 360º gameplay, UI, security, and thematic consistency. By prioritizing safety, readability, and engagement, we created an enjoyable experience. In this abstract, we explore the design challenges and decisions taken to address these issues.","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123625248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Seated-Walking: A Walking-in-Place Technique for Seated VR","authors":"Liwei Chan, Tzu-Wei Mi, Zung-Hao Hsueh, Ming-Yun Hsu","doi":"10.1145/3588027.3595603","DOIUrl":"https://doi.org/10.1145/3588027.3595603","url":null,"abstract":"We present Seated-Walking, a footstep locomotion technique designed for use when sitting on a chair. Seated-Walking is driven by users’ forefoot or rearfoot stepping, which is meant to embody the foot motions of real walking while mitigating potential fatigue. We demonstrate Seated-Walking in two applications. The first application delivers a casual virtual showroom experience, where users sitting iOptoma Corporationn a chair are allowed to walk navigating artworks in the virtual environment. The second application is an intense survival shooter experience where users track and fight enemies while avoiding their attacks, all while seated walking.","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116717380","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Social VR: How Academics Can Use Social VR for Research and Education","authors":"Brian Beams","doi":"10.1145/3588027.3605556","DOIUrl":"https://doi.org/10.1145/3588027.3605556","url":null,"abstract":"While many VR demos involve two users or one using a virtual agent, few contemplate using social VR. Many live demos at industry conferences do not adequately address the social aspect of VR and will not explore its possibilities. Given that Immersive experiences are moving more and more to social VR experiences, it is crucial to discuss its development and implications in various applications, such as arts, games, entertainment, health, and education.","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124874750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Luca E. Taglialatela, Chiao-Ju Chang, Shu-Wen Chen, Yi-Han Chang, Chang-Min Chen, Zih-Huei Yang, Tsung-Min Lin, Shi-yu Ma, Neng-Hao Yu, Mike Y. Chen
{"title":"Alice in Gravityland: Augmenting Gravity Experiences with Around-the-Head Vibrotactile Feedback and Illusory Tactile Motion","authors":"Luca E. Taglialatela, Chiao-Ju Chang, Shu-Wen Chen, Yi-Han Chang, Chang-Min Chen, Zih-Huei Yang, Tsung-Min Lin, Shi-yu Ma, Neng-Hao Yu, Mike Y. Chen","doi":"10.1145/3588027.3595591","DOIUrl":"https://doi.org/10.1145/3588027.3595591","url":null,"abstract":"Alice in Gravityland is a VR adventure exploring three gravity experiences with novel, around-the-head vibrotactile feedback using illusory tactile motion. Players are able to 1) change the direction of gravity, 2) navigate through zero gravity, and 3) defy gravity as they walk on walls. The haptic feedback helps improve players’ sense of directionality to improve immersion when experiencing gravity events. Inspired by Lewis Carroll’s Alice’s Adventures in Wonderland (1865), the game invites players to alter gravity to solve puzzles and experience gravity in a unique way through this multi-sensory VR adventure.","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"9 11-12","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113964453","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Forager","authors":"Winslow Porter, Elie Zananiri","doi":"10.1145/3588027.3603531","DOIUrl":"https://doi.org/10.1145/3588027.3603531","url":null,"abstract":"Forager is a multisensory virtual reality experience that immerses participants in the captivating world of fungi, delivering a profound connection with nature from various perspectives. Engaging sight, sound, touch, and scent, participants witness the complete life cycle of mushrooms, from spores to mycelium, fruiting body, and the inevitable decay. This transformative journey cultivates an appreciation for the interconnectedness of lifeforms and the wonders of the natural world on its own unique time scale. ACM Reference Format: Elias Zananiri, Winslow Porter, and Casta Jiahui Zhu. 2023. Forager: Immersive Mycology Experiences and Time-lapse Photogrammetry. In Special Interest Group on Computer Graphics and Interactive Techniques Conference Immersive Pavilion (SIGGRAPH ’23 Immersive Pavilion), August 06–10, 2023, Los Angeles, CA, USA. ACM, New York, NY, USA, 3 pages. https://doi.org/10.1145/3588027.3603531","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127559589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Asymmetrical VR for Education","authors":"Keru Wang, Zhu Wang, Ken Perlin","doi":"10.1145/3588027.3595600","DOIUrl":"https://doi.org/10.1145/3588027.3595600","url":null,"abstract":"In collocated VR classes, instructors need to guide their students, while also remaining aware of the physical environment in order to ensure students’ safety. It is hard to do both simultaneously. We present a system that utilizes hand-held devices for non-VR instructors, enabling them to explore VR content and interact with students who are fully immersed in VR. The instructor can observe the VR environment or switch between different students’ first-person views by using commonly available hand-held devices, such as smartphones and tablets. The instructor can also use hand-held devices to interact with the VR world itself. The students can see the real-time video stream of the physical environment as well as a video stream of the instructor. The system enables seamless communication and collaboration, thereby helping to create a better and richer educational experience for VR classes.","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"68 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126034138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"THE CALLING VR: A Musical Virtual Reality Experience","authors":"Alani Ilongwe, Christopher Sepulveda, Tim Kashani","doi":"10.1145/3588027.3595598","DOIUrl":"https://doi.org/10.1145/3588027.3595598","url":null,"abstract":"In the three plus years since the COVID-19 pandemic shut down Broadway and regional theaters across the United States, many performing arts institutions are slowly working their way back to pre-pandemic levels in terms of annual revenue [Weinert, 2023]. During this period, many theaters turned to sliding scale ticket models [Mangi, 2022] and hybrid in-person/streamed theater seasons to combat increased inflation related production costs [Vincentelli, 2021]. As we use the lessons learned from the pandemic shutdown to shape the future of American theater, there is a golden opportunity for musical theater producers to embrace virtual reality (VR) technology to reduce development and production related expenses ahead of staging their next musical for a live audience. The Calling: A Musical VR Experience serves as an immersive historical fantasy inspired by the events that transpired during the infamous Memphis Sanitation Strike of 1968. Created in Unity for Oculus Quest I, II, and The Rift S, The Calling was developed as a “guided experience” serving as the prologue for a larger historical musical currently under development with the Tony Award winning producing team at Apples & Oranges Studios.","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126643409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dimix: A Cross-Dimensional Mixed Reality System Based on Latent Diffusion Model","authors":"D. Taniguchi","doi":"10.1145/3588027.3595592","DOIUrl":"https://doi.org/10.1145/3588027.3595592","url":null,"abstract":"Dimix is a system that integrates 2D images generated by Latent Diffusion Models (LDMs) [et al. 2022] with 3D and interactive Mixed Reality (MR) experiences. This system extracts regions from MR scenes based on panoramic images, adds optional mask images, and applies image-inpainting using LDMs to output an LDMs-generated image (LDMs image) that naturally extends the scene. Furthermore, by performing depth estimation on the images and reconstructing them as 3D scenes, the LDMs image can be treated in the same manner as 3D objects. This enables both basic features like occlusion and collision detection and highly interactive operations such as ink painting, achieving high immersion and realism. Additionally, the system incorporates real-time object detection to constrain the inpainting area, making the LDMs image more convincing. All processing is performed in real-time, allowing users to interact with the world in 3D without waiting for loading or any other preparation by simply uploading their preferred panorama image to the application. To our best knowledge, Dimix is the first system to seamlessly integrate LDMs images into interactive and three-dimensional MR experiences. Users can immerse themselves in an unprecedented space where the real world seamlessly blends with a world generated by a neural network, offering a glimpse into the future of MR experiences.","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"135 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129997896","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Digital Dance Studio VR (DDS-VR): An innovative user-focused immersive software application for digital choreographic composition, planning, teaching, learning, and rehearsal.","authors":"Alexander Whitley, Sönke Kirchhof, Dan Strutt","doi":"10.1145/3588027.3595602","DOIUrl":"https://doi.org/10.1145/3588027.3595602","url":null,"abstract":"The Digital Dance Studio VR (DDS-VR) is an innovative user-focused immersive software application for choreographic composition, planning, teaching, learning, and rehearsal. It offers a simple and intuitive immersive interface for creation and manipulation of choreographic sequences in virtual space, permitting exploration of spatial and temporal patterning, musical accompaniment, environment and design aesthetics, and allowing users to change the position, number, rhythm and orientation of dancers. It provides a suite of modular tools for choreographers, dancers, and anyone interested in exploring movement in a digital context – including Film and TV applications in blocking/storyboarding of fight and crowd sequences. The DDS-VR application can empower users to create, visualize, and share digital choreography outside of the physical studio, saving considerable time and money on studio and personnel hire, and bypassing the more professionalized use of real-time graphics software such as Unity and Unreal.","PeriodicalId":301047,"journal":{"name":"ACM SIGGRAPH 2023 Immersive Pavilion","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126447958","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}