Externalizing Mental Images by Harnessing Size-Describing Gestures: Design Implications for a Visualization System

S. A. Brown, Sharon Lynn Chu Yew Yee, Neha Rani
{"title":"Externalizing Mental Images by Harnessing Size-Describing Gestures: Design Implications for a Visualization System","authors":"S. A. Brown, Sharon Lynn Chu Yew Yee, Neha Rani","doi":"10.1145/3399715.3399920","DOIUrl":null,"url":null,"abstract":"People use a significant amount of gestures when engaging in creative brainstorming. This is especially typical for creative workers who frequently convey ideas, designs, and stories to team members. These gestures produced during natural conversation contain information that is not necessarily conveyed through speech. This paper investigates the design of a system that uses people's gestures in natural communication contexts to produce external visualizations of their mental imagery, focusing on gestures that describe dimension-related information. While much psycholinguistics research address how gestures relate to the representations of concepts, little HCI work has explored the possibilities of harnessing gestures to support thinking. We conducted a study to explore how people gesture using a basic gesture-based visualization system in simulated creative gift design scenarios, towards the goal of deriving design implications. Both quantitative and qualitative data were collected from the study, allowing us to ascertain what features (e.g., users' spatial frames of reference and listener types) of a gesture-based visualization system need to be accounted for in design. Results showed that our system managed to visualize users' envisioned gift dimensions, but that visualized object area significantly affected users' perceived accuracy of the system. We extract themes as to what dimensions are important in the design of a gesture-based visualization system, and the possible uses of such a system from the participants' perspectives. We discuss implications for the design of gesture-based visualization systems to support creative work and possibilities for future directions of research.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the International Conference on Advanced Visual Interfaces","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3399715.3399920","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

People use a significant amount of gestures when engaging in creative brainstorming. This is especially typical for creative workers who frequently convey ideas, designs, and stories to team members. These gestures produced during natural conversation contain information that is not necessarily conveyed through speech. This paper investigates the design of a system that uses people's gestures in natural communication contexts to produce external visualizations of their mental imagery, focusing on gestures that describe dimension-related information. While much psycholinguistics research address how gestures relate to the representations of concepts, little HCI work has explored the possibilities of harnessing gestures to support thinking. We conducted a study to explore how people gesture using a basic gesture-based visualization system in simulated creative gift design scenarios, towards the goal of deriving design implications. Both quantitative and qualitative data were collected from the study, allowing us to ascertain what features (e.g., users' spatial frames of reference and listener types) of a gesture-based visualization system need to be accounted for in design. Results showed that our system managed to visualize users' envisioned gift dimensions, but that visualized object area significantly affected users' perceived accuracy of the system. We extract themes as to what dimensions are important in the design of a gesture-based visualization system, and the possible uses of such a system from the participants' perspectives. We discuss implications for the design of gesture-based visualization systems to support creative work and possibilities for future directions of research.
利用尺寸描述手势外化心理图像:可视化系统的设计含义
在进行创造性头脑风暴时,人们会使用大量的手势。这对于经常向团队成员传达想法、设计和故事的创意工作者来说尤其典型。这些在自然对话中产生的手势包含了不一定通过语言传达的信息。本文研究了一个系统的设计,该系统使用人们在自然交流环境中的手势来产生他们心理意象的外部可视化,重点关注描述维度相关信息的手势。虽然许多心理语言学研究都在探讨手势与概念表征之间的关系,但很少有人机交互研究探索利用手势支持思维的可能性。我们进行了一项研究,探索人们在模拟创意礼品设计场景中如何使用基于基本手势的可视化系统,以获得设计启示。从研究中收集了定量和定性数据,使我们能够确定在设计中需要考虑基于手势的可视化系统的哪些特征(例如,用户的空间参考框架和听众类型)。结果表明,我们的系统成功地将用户设想的礼物尺寸可视化,但可视化的物体面积显著影响用户对系统的感知准确性。我们提取了一些主题,如在基于手势的可视化系统的设计中哪些维度是重要的,以及从参与者的角度来看这种系统的可能用途。我们讨论了基于手势的可视化系统设计的含义,以支持创造性工作和未来研究方向的可能性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信