DualCAD: Integrating Augmented Reality with a Desktop GUI and Smartphone Interaction

2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct) Pub Date : 2016-09-01 DOI:10.1109/ISMAR-Adjunct.2016.0030

Alexandre Millette, Michael J. McGuffin

{"title":"DualCAD: Integrating Augmented Reality with a Desktop GUI and Smartphone Interaction","authors":"Alexandre Millette, Michael J. McGuffin","doi":"10.1109/ISMAR-Adjunct.2016.0030","DOIUrl":null,"url":null,"abstract":"Head-Mounted Displays (HMDs) combined with 3-or-more Degree-of-Freedom (DoF) input enable rapid manipulation of stereoscopic 3D content. However, such input is typically performed with hands in midair and therefore lacks precision and stability. Also, recent consumer-grade HMDs suffer from limited angular resolution and/or limited field-of-view as compared to a desktop monitor. We present the DualCAD system that implements two solutions to these problems. First, the user may freely switch at runtime between an augmented reality HMD mode, and a traditional desktop mode with precise 2D mouse input and an external desktop monitor. Second, while in the augmented reality HMD mode, the user holds a smartphone in their non-dominant hand that is tracked with 6 DoF, allowing it to be used as a complementary high-resolution display as well as an alternative input device for stylus or multitouch input. Two novel bimanual interaction techniques that leverage the properties of the smartphone are presented. We also report initial user feedback.","PeriodicalId":171967,"journal":{"name":"2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"50","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISMAR-Adjunct.2016.0030","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 50

Abstract

Head-Mounted Displays (HMDs) combined with 3-or-more Degree-of-Freedom (DoF) input enable rapid manipulation of stereoscopic 3D content. However, such input is typically performed with hands in midair and therefore lacks precision and stability. Also, recent consumer-grade HMDs suffer from limited angular resolution and/or limited field-of-view as compared to a desktop monitor. We present the DualCAD system that implements two solutions to these problems. First, the user may freely switch at runtime between an augmented reality HMD mode, and a traditional desktop mode with precise 2D mouse input and an external desktop monitor. Second, while in the augmented reality HMD mode, the user holds a smartphone in their non-dominant hand that is tracked with 6 DoF, allowing it to be used as a complementary high-resolution display as well as an alternative input device for stylus or multitouch input. Two novel bimanual interaction techniques that leverage the properties of the smartphone are presented. We also report initial user feedback.

查看原文本刊更多论文

DualCAD:集成增强现实与桌面GUI和智能手机交互

头戴式显示器(hmd)与3个或更多自由度(DoF)输入相结合，可以快速操作立体3D内容。然而，这种输入通常是用手在半空中进行的，因此缺乏精度和稳定性。此外，与台式显示器相比，最近的消费级hmd受到角度分辨率和/或视野范围的限制。我们提出了DualCAD系统，实现了两个解决这些问题的方案。首先，用户可以在运行时在增强现实HMD模式和传统桌面模式之间自由切换，传统桌面模式具有精确的2D鼠标输入和外部桌面显示器。其次，在增强现实HMD模式下，用户用非主手拿着智能手机，该智能手机具有6自由度，可以用作补充的高分辨率显示器，也可以作为触控笔或多点触控输入的替代输入设备。提出了两种利用智能手机特性的新型人机交互技术。我们还报告初始用户反馈。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)

自引率

0.00%

发文量