人工智能驱动的家庭互动在融合空间和时间

IF 1.6 4区计算机科学 Q3 COMPUTER SCIENCE, INFORMATION SYSTEMS

IEEE Pervasive Computing Pub Date : 2023-01-01 DOI:10.1109/MPRV.2022.3232620

Bumsoo Kang, Seungwoo Kang, Inseok Hwang

{"title":"人工智能驱动的家庭互动在融合空间和时间","authors":"Bumsoo Kang, Seungwoo Kang, Inseok Hwang","doi":"10.1109/MPRV.2022.3232620","DOIUrl":null,"url":null,"abstract":"Computer-mediated interaction services connect people over a distance. However, we address that those people are often “locked in a frame”—which includes an interaction mode, a point in time, or a context of either person. We observe that such lock-ins make it difficult to shape the interaction to be mutually symmetric. In this article, we propose a semantic-equivalent melding of space and time to provide a new form of empathetic interaction. We present HomeMeld and MomentMeld, which aim to meld space and time by applying AI, respectively. HomeMeld provides a sense of living together to a family living apart with AI-driven autonomous robotic avatars. MomentMeld utilizes an ensemble of visual AI to create interaction topics by matching semantic-equivalent photos. In-the-wild experiments reveal that HomeMeld and MomentMeld open new possibilities for empathetic interaction. Finally, we introduce a new interaction service leveraging technical synergy of HomeMeld and MomentMeld.","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"22 1","pages":"85-94"},"PeriodicalIF":1.6000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"AI-driven Family Interaction Over Melded Space and Time\",\"authors\":\"Bumsoo Kang, Seungwoo Kang, Inseok Hwang\",\"doi\":\"10.1109/MPRV.2022.3232620\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Computer-mediated interaction services connect people over a distance. However, we address that those people are often “locked in a frame”—which includes an interaction mode, a point in time, or a context of either person. We observe that such lock-ins make it difficult to shape the interaction to be mutually symmetric. In this article, we propose a semantic-equivalent melding of space and time to provide a new form of empathetic interaction. We present HomeMeld and MomentMeld, which aim to meld space and time by applying AI, respectively. HomeMeld provides a sense of living together to a family living apart with AI-driven autonomous robotic avatars. MomentMeld utilizes an ensemble of visual AI to create interaction topics by matching semantic-equivalent photos. In-the-wild experiments reveal that HomeMeld and MomentMeld open new possibilities for empathetic interaction. Finally, we introduce a new interaction service leveraging technical synergy of HomeMeld and MomentMeld.\",\"PeriodicalId\":55021,\"journal\":{\"name\":\"IEEE Pervasive Computing\",\"volume\":\"22 1\",\"pages\":\"85-94\"},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Pervasive Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1109/MPRV.2022.3232620\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Pervasive Computing","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1109/MPRV.2022.3232620","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}

引用次数: 3

摘要

以计算机为媒介的交互服务将人们远距离连接起来。然而，我们指出，这些人往往被“锁定在一个框架中”——这包括一种互动模式、一个时间点或任何一个人的背景。我们观察到，这种锁定使相互作用难以形成相互对称的形状。在这篇文章中，我们提出了一种空间和时间的语义等价融合，以提供一种新的移情互动形式。我们介绍了HomeMeld和MomentMeld，它们分别旨在通过应用人工智能来融合空间和时间。HomeMeld通过人工智能驱动的自主机器人化身为一个分开生活的家庭提供了一种共同生活的感觉。MomentMeld利用视觉AI的集成，通过匹配语义等效的照片来创建交互主题。在野外实验中，HomeMeld和MomentMeld为移情互动开辟了新的可能性。最后，我们介绍了一种利用HomeMeld和MomentMeld的技术协同作用的新交互服务。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

AI-driven Family Interaction Over Melded Space and Time

Computer-mediated interaction services connect people over a distance. However, we address that those people are often “locked in a frame”—which includes an interaction mode, a point in time, or a context of either person. We observe that such lock-ins make it difficult to shape the interaction to be mutually symmetric. In this article, we propose a semantic-equivalent melding of space and time to provide a new form of empathetic interaction. We present HomeMeld and MomentMeld, which aim to meld space and time by applying AI, respectively. HomeMeld provides a sense of living together to a family living apart with AI-driven autonomous robotic avatars. MomentMeld utilizes an ensemble of visual AI to create interaction topics by matching semantic-equivalent photos. In-the-wild experiments reveal that HomeMeld and MomentMeld open new possibilities for empathetic interaction. Finally, we introduce a new interaction service leveraging technical synergy of HomeMeld and MomentMeld.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

IEEE Pervasive Computing 工程技术-电信学

CiteScore

4.10

自引率

0.00%

发文量

审稿时长

>12 weeks

期刊介绍： IEEE Pervasive Computing explores the role of computing in the physical world–as characterized by visions such as the Internet of Things and Ubiquitous Computing. Designed for researchers, practitioners, and educators, this publication acts as a catalyst for realizing the ideas described by Mark Weiser in 1988. The essence of this vision is the creation of environments saturated with sensing, computing, and wireless communication that gracefully support the needs of individuals and society. Many key building blocks for this vision are now viable commercial technologies: wearable and handheld computers, wireless networking, location sensing, Internet of Things platforms, and so on. However, the vision continues to present deep challenges for experts in areas such as hardware design, sensor networks, mobile systems, human-computer interaction, industrial design, machine learning, data science, and societal issues including privacy and ethics. Through special issues, the magazine explores applications in areas such as assisted living, automotive systems, cognitive assistance, hardware innovations, ICT4D, manufacturing, retail, smart cities, and sustainability. In addition, the magazine accepts peer-reviewed papers of wide interest under a general call, and also features regular columns on hot topics and interviews with luminaries in the field.