Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces最新文献

A Refreshable Tactile Display Effectively Supports Cognitive Mapping Followed by Orientation and Mobility Tasks: A Comparative Multi-modal Study Involving Blind and Low-vision Participants 一个可刷新的触觉显示有效地支持认知映射随后的定向和移动任务:一项涉及盲人和低视力参与者的比较多模态研究

Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces Pub Date : 2019-10-15 DOI: 10.1145/3347319.3356840

L. Brayda, Fabrizio Leo, Caterina Baccelliere, Claudia Vigini, E. Cocchi

引用次数: 3

HaptWrap: Augmenting Non-Visual Travel via Visual-to-Tactile Mapping of Objects in Motion HaptWrap:通过运动中物体的视觉到触觉映射来增强非视觉旅行

Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces Pub Date : 2019-10-15 DOI: 10.1145/3347319.3356835

Bryan Duarte, T. McDaniel, Abhik Chowdhury, Sana Gill, S. Panchanathan

{"title":"HaptWrap: Augmenting Non-Visual Travel via Visual-to-Tactile Mapping of Objects in Motion","authors":"Bryan Duarte, T. McDaniel, Abhik Chowdhury, Sana Gill, S. Panchanathan","doi":"10.1145/3347319.3356835","DOIUrl":"https://doi.org/10.1145/3347319.3356835","url":null,"abstract":"Access to real-time situational information at a distance, including the relative position and motion of surrounding objects, is essential for an individual to travel safely and independently. For blind and low vision travelers, access to critical environmental information is unattainable if it is positioned beyond the reach of their preferred mobility aid or outside their path of travel. Due to its cost and versatility, and the dynamic information which can be aggregated through its use, the long white cane remains the most widely used mobility aid for non-visual travelers. Physical characteristics such as texture, slope, and position can be identified with the long white cane, but only when the traveler is within close proximity to an object. In this work, we introduce a wearable technology to augment non-visual travel methods by communicating spatial information at a distance. We propose a vibrotactile device, the HaptWrap, equipped with vibration motors capable of communicating an object's position relative to the user's orientation, as well as its relative variations in position as the object moves about the user. An experiment supports the use of haptics to represent objects in motion around an individual as a substitute modality for vision.","PeriodicalId":420165,"journal":{"name":"Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces","volume":"133 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117194119","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Emotion Recognition with Simulated Phosphene Vision 模拟光幻视的情绪识别

Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces Pub Date : 2019-10-15 DOI: 10.1145/3347319.3356836

Caroline Bollen, R. van Wezel, M. V. van Gerven, Yağmur Güçlütürk

{"title":"Emotion Recognition with Simulated Phosphene Vision","authors":"Caroline Bollen, R. van Wezel, M. V. van Gerven, Yağmur Güçlütürk","doi":"10.1145/3347319.3356836","DOIUrl":"https://doi.org/10.1145/3347319.3356836","url":null,"abstract":"Electrical stimulation of retina, optic nerve or cortex is found to elicit visual sensations, known as phosphenes. This allows visual prosthetics to partially restore vision by representing the visual field as a phosphene pattern. Since the resolution and performance of visual prostheses are limited, only a fraction of the information in a visual scene can be represented by phosphenes. Here, we propose a simple yet powerful image processing strategy for recognizing facial expressions with prosthetic vision, supporting communication and social interaction in the blind. A psychophysical study was conducted to investigate whether a landmark-based representation of facial expressions could improve emotion detection with prosthetic vision. Our approach was compared to edge detection, which is commonly used in current retinal prosthetic devices. Additionally, the relationship between the number of phosphenes and accuracy of emotion recognition was studied. The landmark model improved accuracy of emotion recognition, regardless of the number of phosphenes. Secondly, the accuracy improved with an increasing number of phosphenes up to a saturation point. The performance saturated with fewer phosphenes with the landmark model than with edge detection. These results suggest that landmark-based image pre-processing allows for a more efficient use of the limited information that can be stored in a phosphene pattern, providing a route towards more meaningful and higher-quality perceptual experience in subjects with prosthetic vision.","PeriodicalId":420165,"journal":{"name":"Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces","volume":"194-199 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130685623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Gaze Detection and Prediction Using Data from Infrared Cameras 基于红外相机数据的凝视检测与预测

Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces Pub Date : 2019-10-15 DOI: 10.1145/3347319.3356838

Yingxuan Zhu, Wenyou Sun, T. Yuan, Jian Li

引用次数: 0

Continuous Sign Language Recognition Based on Pseudo-supervised Learning 基于伪监督学习的连续手语识别

Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces Pub Date : 2019-10-15 DOI: 10.1145/3347319.3356837

Xiankun Pei, Dan Guo, Ye Zhao

引用次数: 5

Semantic Enhanced Encoder-Decoder Network (SEN) for Video Captioning 语义增强的视频字幕编解码器网络(SEN)

Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces Pub Date : 2019-10-15 DOI: 10.1145/3347319.3356839

Yuling Gui, Dan Guo, Ye Zhao

引用次数: 2

Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces 第二届无障碍人机界面多媒体研讨会论文集

Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces Pub Date : 1900-01-01 DOI: 10.1145/3347319

引用次数: 0