Learning and navigating digitally rendered haptic spatial layouts

IF 3.6 1区 心理学 Q1 EDUCATION & EDUCATIONAL RESEARCH
Ruxandra I. Tivadar, Benedetta Franceschiello, Astrid Minier, Micah M. Murray
{"title":"Learning and navigating digitally rendered haptic spatial layouts","authors":"Ruxandra I. Tivadar, Benedetta Franceschiello, Astrid Minier, Micah M. Murray","doi":"10.1038/s41539-023-00208-4","DOIUrl":null,"url":null,"abstract":"<p>Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, blindfolded participants first learned the basic layout of an apartment based on digital haptics only and then one of two trajectories through it. While still blindfolded, participants successfully reconstructed the haptically learned 2D spaces and navigated these spaces. Digital haptics were thus an effective means to learn and translate, on the one hand, 2D images into 3D reconstructions of layouts and, on the other hand, navigate actions within real spaces. Digital haptics based on ultrasounds represent an alternative learning tool for complex scenes as well as for successful navigation in previously unfamiliar layouts, which can likely be further applied in the rehabilitation of spatial functions and mitigation of visual impairments.</p>","PeriodicalId":48503,"journal":{"name":"npj Science of Learning","volume":null,"pages":null},"PeriodicalIF":3.6000,"publicationDate":"2023-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"npj Science of Learning","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1038/s41539-023-00208-4","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

Abstract

Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, blindfolded participants first learned the basic layout of an apartment based on digital haptics only and then one of two trajectories through it. While still blindfolded, participants successfully reconstructed the haptically learned 2D spaces and navigated these spaces. Digital haptics were thus an effective means to learn and translate, on the one hand, 2D images into 3D reconstructions of layouts and, on the other hand, navigate actions within real spaces. Digital haptics based on ultrasounds represent an alternative learning tool for complex scenes as well as for successful navigation in previously unfamiliar layouts, which can likely be further applied in the rehabilitation of spatial functions and mitigation of visual impairments.

Abstract Image

学习和浏览数字渲染的触觉空间布局
学习空间布局和浏览空间布局不仅仅依靠视觉,而是依靠包括触觉在内的多感官过程。基于超声波的数字触觉可以有效地为视力正常和视力受损的参与者创建和操作单个物体的心理图像。在这里,我们测试了这是否适用于场景和场景中的导航。25 名视力正常的蒙眼参与者仅通过数字触摸屏(即数字交互式地图)上的超声波反馈来获得触觉刺激,他们首先仅通过数字触觉来了解公寓的基本布局,然后从两条路线中选择一条穿过公寓。在仍然蒙着眼睛的情况下,参与者成功地重建了通过触觉学习到的二维空间,并在这些空间中进行了导航。因此,数字触觉是一种有效的学习手段,一方面可以将二维图像转化为三维重建布局,另一方面还可以在真实空间中进行导航操作。以超声波为基础的数字触觉技术是复杂场景的另一种学习工具,也是在以前不熟悉的布局中成功导航的另一种学习工具,有可能进一步应用于空间功能的康复和视力障碍的缓解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
5.40
自引率
7.10%
发文量
29
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信