... IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)最新文献
Jaewook Lee, Yang Li, Dylan Bunarto, Eujean Lee, Olivia H Wang, Adrian Rodriguez, Yuhang Zhao, Yapeng Tian, Jon E Froehlich
{"title":"Towards AI-Powered AR for Enhancing Sports Playability for People with Low Vision: An Exploration of ARSports.","authors":"Jaewook Lee, Yang Li, Dylan Bunarto, Eujean Lee, Olivia H Wang, Adrian Rodriguez, Yuhang Zhao, Yapeng Tian, Jon E Froehlich","doi":"10.1109/ismar-adjunct64951.2024.00055","DOIUrl":"10.1109/ismar-adjunct64951.2024.00055","url":null,"abstract":"<p><p>People with low vision (LV) experience challenges in visually tracking balls and players in sports like basketball and tennis, which can adversely impact their participation and health. We introduce <i>ARSports</i>, a wearable AR research prototype that overlays instance segmentation masks in near real-time for improving sports accessibility. To create ARSports, we manually collected and annotated novel first-person perspective sports datasets, fine-tuned instance segmentation models using this labeled data, and built an initial wearable AR prototype by combining the <i>ZED Mini</i> stereo camera with the <i>Oculus Quest 2</i> VR headset. Our evaluations suggest that combining real-time computer vision and augmented reality to create scene-aware visual augmentations is a promising approach to enhancing sports participation for LV individuals. We contribute open-sourced egocentric basketball and tennis datasets and models, as well as insights and design recommendations from our pilot study with an LV research team member.</p>","PeriodicalId":519868,"journal":{"name":"... IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)","volume":"2024 ","pages":"228-233"},"PeriodicalIF":0.0,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12279022/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144683988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xiaorui Zhang, Andreas Keller, Mehran Armand, Alejandro Martin Gomez
{"title":"Feasibility Study of Using Augmented Mirrors for Alignment Task during Orthopaedic Procedures in Mixed Reality.","authors":"Xiaorui Zhang, Andreas Keller, Mehran Armand, Alejandro Martin Gomez","doi":"10.1109/ismar-adjunct60411.2023.00139","DOIUrl":"https://doi.org/10.1109/ismar-adjunct60411.2023.00139","url":null,"abstract":"<p><p>Accurate depth estimation poses a significant challenge in egocentric Augmented Reality (AR), particularly for precision-dependent tasks in the medical field, such as needle or tool insertions during percutaneous procedures. Augmented Mirrors (AMs) provide a unique solution to this problem by offering additional non-egocentric viewpoints that enhance spatial understanding of an AR scene. Despite the perceptual advantages of using AMs, their practical utility has yet to be thoroughly tested. In this work, we present results from a pilot study involving five participants tasked with simulating epidural injection procedures in an AR environment, both with and without the aid of an AM. Our findings indicate that using AM contributes to reducing mental effort while improving alignment accuracy. These results highlight the potential of AM as a powerful tool for AR-enabled medical procedures, setting the stage for future exploration involving medical professionals.</p>","PeriodicalId":519868,"journal":{"name":"... IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)","volume":"2023 ","pages":"650-651"},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10986428/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140874373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}