2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)最新文献

ARsinoë - Learning Egyptian Hieroglyphs with Augmented Reality and Machine Learning ARsinoë -学习埃及象形文字与增强现实和机器学习

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00092

D. A. Plecher, Christian Eichhorn, Khaled M. Seyam, G. Klinker

引用次数: 3

Small Marker Tracking with Low-Cost, Unsynchronized, Movable Consumer Cameras For Augmented Reality Surgical Training 用于增强现实外科训练的低成本、非同步、可移动消费者相机的小标记跟踪

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00038

Nicholas Rewkowski, A. State, H. Fuchs

{"title":"Small Marker Tracking with Low-Cost, Unsynchronized, Movable Consumer Cameras For Augmented Reality Surgical Training","authors":"Nicholas Rewkowski, A. State, H. Fuchs","doi":"10.1109/ISMAR-Adjunct51615.2020.00038","DOIUrl":"https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00038","url":null,"abstract":"Surgeons improve their skills through repetition of training tasks in order to operate on living patients, ideally receiving timely, useful, and objective performance feedback. However, objective performance measurement is currently difficult without 3D visualization, with effective surgical training apparatus being extremely expensive or limited in accessibility. This is problematic for medical students, especially in situations such as the COVID-19 pandemic in which they are needed by the community but have few ways of practicing without lab access. In this work, we propose and prototype a system for augmented reality (AR) visualization of laparoscopic training tasks using cheap and widely-compatible borescopes, which can track small objects typical of surgical training. We use forward kinematics for calibration and multi-threading to attempt synchronization in order to increase compatibility with consumer applications, resulting in an effective AR simulation with low-cost devices and consumer software, while also providing dynamic camera and marker tracking. We test the system with a typical peg transfer task on the HoloLens 1 and MagicLeap One.","PeriodicalId":433361,"journal":{"name":"2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124650873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

HuTrain: a Framework for Fast Creation of Real Human Pose Datasets HuTrain:一个快速创建真实人体姿势数据集的框架

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00031

R. R. Barioni, W. Costa, J. A. C. Neto, L. Figueiredo, V. Teichrieb, J. Quintino, F. Q. Silva, André L. M. Santos, Helder Pinho

{"title":"HuTrain: a Framework for Fast Creation of Real Human Pose Datasets","authors":"R. R. Barioni, W. Costa, J. A. C. Neto, L. Figueiredo, V. Teichrieb, J. Quintino, F. Q. Silva, André L. M. Santos, Helder Pinho","doi":"10.1109/ISMAR-Adjunct51615.2020.00031","DOIUrl":"https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00031","url":null,"abstract":"Image-based body tracking algorithms are useful in several scenarios, such as avatar animations and gesture interaction for VR applications. In the last few years, the best-ranked solutions presented on the state of the art of body tracking (according to the most popular datasets in the field) are intensively based on Convolutional Neural Networks (CNNs) algorithms and use large datasets for training and validation. Although these solutions achieve high precision scores while evaluated with some of these datasets, there are particular tracking challenges (for example, upside-down cases) that are not well-modeled and, therefore, not correctly tracked. Instead of lurking an all-in-one solution for all cases, we propose HuTrain, a framework for creating datasets quickly and easily. HuTrain comprises a series of steps, including automatic camera calibration, refined human pose estimation, and known dataset formats conversion. We show that, with our system, the user can generate human pose datasets, targeting specific tracking challenges for the desired application context, with no need to annotate human pose instances manually.","PeriodicalId":433361,"journal":{"name":"2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130527014","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

A Sense of Quality for Augmented Reality Assisted Process Guidance 增强现实辅助过程指导的质量意识

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00046

Anes Redžepagić, Christoffer Loeffler, Tobias Feigl, Christopher Mutschler

{"title":"A Sense of Quality for Augmented Reality Assisted Process Guidance","authors":"Anes Redžepagić, Christoffer Loeffler, Tobias Feigl, Christopher Mutschler","doi":"10.1109/ISMAR-Adjunct51615.2020.00046","DOIUrl":"https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00046","url":null,"abstract":"The ongoing automation of modern production processes requires novel human-computer interaction concepts that support employees in dealing with the unstoppable increase in time pressure, cognitive load, and the required fine-grained and process-specific knowledge. Augmented Reality (AR) systems support employees by guiding and teaching work processes. Such systems still lack a precise process quality analysis (monitoring), which is, however, crucial to close gaps in the quality assurance of industrial processes.We combine inertial sensors, mounted on work tools, with AR headsets to enrich modern assistance systems with a sense of process quality. For this purpose, we develop a Machine Learning (ML) classifier that predicts quality metrics from a 9-degrees of freedom inertial measurement unit, while we simultaneously guide and track the work processes with a HoloLens AR system. In our user study, 6 test subjects perform typical assembly tasks with our system. We evaluate the tracking accuracy of the system based on a precise optical reference system and evaluate the classification of each work step quality based on the collected ground truth data. Our evaluation shows a tracking accuracy of fast dynamic movements of 4.92mm and our classifier predicts the actions carried out with mean F1 value of 93.8% on average.","PeriodicalId":433361,"journal":{"name":"2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121342855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Pleistocene Crete: A narrative, interactive mixed reality exhibition that brings prehistoric wildlife back to life 克里特岛更新世:一个叙事、互动的混合现实展览，将史前野生动物带回生活

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00069

K. C. Apostolakis, G. Margetis, C. Stephanidis

引用次数: 3

Augmented Reality for Easy Sailing 增强现实轻松航行

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00088

Francesco Laera

引用次数: 1

Stepping over Obstacles with Augmented Reality based on Visual Exproprioception 基于视觉感知的增强现实跨障技术

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00039

Alessandro Luchetti, Edoardo Parolin, I. Butaslac, Yuichiro Fujimoto, M. Kanbara, P. Bosetti, M. Cecco, H. Kato

{"title":"Stepping over Obstacles with Augmented Reality based on Visual Exproprioception","authors":"Alessandro Luchetti, Edoardo Parolin, I. Butaslac, Yuichiro Fujimoto, M. Kanbara, P. Bosetti, M. Cecco, H. Kato","doi":"10.1109/ISMAR-Adjunct51615.2020.00039","DOIUrl":"https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00039","url":null,"abstract":"The purpose of this study is to analyze the different kinds of ex- proprioceptive visual cues on an Augmented Reality (AR) system during gait exercise, on top of understanding which cues provide the best visualizations in stepping over obstacles. The main problem for users is to understand the position of virtual objects relative to themselves. Since visual exproprioception provides information about the body position in relation to the environment, it has the possibility to yield positive effects with regards to position control and gait biomechanics in the AR system. This research was born as part of the collaboration with the staff of Takanohara Central Hospital in Japan. Twenty-seven individuals were invited to take part in the user study to test three visual interfaces. The task of the mentioned user study involves making the subjects cross and avoid virtual obstacles of different heights that come from different directions. The AR application was implemented in the experiment by using the Head-Mounted Display (HMD) Microsoft HoloLens. Data obtained from the experiment revealed that the interface projected in front of the user from a third-person point of view resulted to improvements in terms of posture, visual stimuli, and safety.","PeriodicalId":433361,"journal":{"name":"2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133246107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Intelligent Adaptive Agents and Trust in Virtual and Augmented Reality 虚拟与增强现实中的智能自适应代理与信任

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00085

Ningyuan Sun, J. Botev

引用次数: 1

Effects of Background Complexity and Viewing Distance on an AR Visual Search Task 背景复杂度和观看距离对AR视觉搜索任务的影响

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00057

Hyunjin Lee, Sunyoung Bang, Woontack Woo

{"title":"Effects of Background Complexity and Viewing Distance on an AR Visual Search Task","authors":"Hyunjin Lee, Sunyoung Bang, Woontack Woo","doi":"10.1109/ISMAR-Adjunct51615.2020.00057","DOIUrl":"https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00057","url":null,"abstract":"Information in augmented reality (AR) consists of virtual and real contexts and is provided to the AR environment at different distances for each user. Therefore, it is important to understand how the integration of two different information influences the user’s AR experience. However, little has been studied regarding the complexity and viewing distance of a real space. Our study investigates how the complexity of the physical environment and viewing distance influence workload and performance in a visual search task in an AR environment. We conducted an experiment in which participants performed conjunction search under three different levels of background complexity, at both near (1.5m) and far (3m) distances. The results indicated that as the complexity of the background increased, the users’ performance time and workload were negatively impacted. In addition, when the distance between the user and the background was greater, search time increased. From the results of the study, we derived some recommendations for the design of AR interfaces. Our research contributes to the design of interfaces by demonstrating the necessity to consider the complexity of background and viewing distance.","PeriodicalId":433361,"journal":{"name":"2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)","volume":"91 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115117272","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

AR-Chat: an AR-based instant messaging system AR-Chat:一个基于ar的即时通讯系统

2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) Pub Date : 2020-11-01 DOI: 10.1109/ISMAR-Adjunct51615.2020.00050

Pierrick Jouet, Vincent Alleaume, Anthony Laurent, Matthieu Fradet, Tao Luo, C. Baillard

引用次数: 3