ThrowIO: Actuated TUIs that Facilitate “Throwing and Catching” Spatial Interaction with Overhanging Mobile Wheeled Robots

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems Pub Date : 2023-04-19 DOI:10.1145/3544548.3581267

Ting-Han Lin, Willa Yunqi Yang, Ken Nakagaki

{"title":"ThrowIO: Actuated TUIs that Facilitate “Throwing and Catching” Spatial Interaction with Overhanging Mobile Wheeled Robots","authors":"Ting-Han Lin, Willa Yunqi Yang, Ken Nakagaki","doi":"10.1145/3544548.3581267","DOIUrl":null,"url":null,"abstract":"We introduce ThrowIO, a novel style of actuated tangible user interface that facilitates throwing and catching spatial interaction powered by mobile wheeled robots on overhanging surfaces. In our approach, users throw and stick objects that are embedded with magnets to an overhanging ferromagnetic surface where wheeled robots can move and drop them at desired locations, allowing users to catch them. The thrown objects are tracked with an RGBD camera system to perform closed-loop robotic manipulations. By computationally facilitating throwing and catching interaction, our approach can be applied in many applications including kinesthetic learning, gaming, immersive haptic experience, ceiling storage, and communication. We demonstrate the applications with a proof-of-concept system enabled by wheeled robots, ceiling hardware design, and software control. Overall, ThrowIO opens up novel spatial, dynamic, and tangible interaction for users via overhanging robots, which has great potential to be integrated into our everyday space.","PeriodicalId":314098,"journal":{"name":"Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems","volume":"38 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3544548.3581267","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 2

Abstract

We introduce ThrowIO, a novel style of actuated tangible user interface that facilitates throwing and catching spatial interaction powered by mobile wheeled robots on overhanging surfaces. In our approach, users throw and stick objects that are embedded with magnets to an overhanging ferromagnetic surface where wheeled robots can move and drop them at desired locations, allowing users to catch them. The thrown objects are tracked with an RGBD camera system to perform closed-loop robotic manipulations. By computationally facilitating throwing and catching interaction, our approach can be applied in many applications including kinesthetic learning, gaming, immersive haptic experience, ceiling storage, and communication. We demonstrate the applications with a proof-of-concept system enabled by wheeled robots, ceiling hardware design, and software control. Overall, ThrowIO opens up novel spatial, dynamic, and tangible interaction for users via overhanging robots, which has great potential to be integrated into our everyday space.

查看原文本刊更多论文

ThrowIO:驱动的ui，促进“投掷和捕捉”空间交互与悬垂移动轮式机器人

我们介绍了ThrowIO，这是一种新颖的驱动的有形用户界面，便于投掷和捕捉由悬垂表面上的移动轮式机器人驱动的空间交互。在我们的方法中，用户将嵌入磁铁的物体扔到悬垂的铁磁表面上，轮式机器人可以移动并将它们放置在所需的位置，允许用户抓住它们。投掷的物体被RGBD相机系统跟踪，以执行闭环机器人操作。通过计算促进投掷和接球的相互作用，我们的方法可以应用于许多应用，包括动觉学习，游戏，沉浸式触觉体验，天花板存储和通信。我们通过轮式机器人、天花板硬件设计和软件控制实现的概念验证系统演示了这些应用。总的来说，ThrowIO通过悬垂机器人为用户开辟了新颖的空间、动态和有形的互动，这有很大的潜力融入我们的日常空间。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

自引率

0.00%

发文量