The role of multisensory feedback in haptic surface perception

Abstract

In performing most everyday tasks, we use information from several different sensory modalities, yet our understanding of how these inputs are integrated is limited. The present study investigated the role of multisensory feedback in the perception of surface roughness, specifically focusing on whether the threshold for distinguishing the roughness of two virtual surfaces was different under visual + haptic conditions, as compared to visual-only or haptic-only conditions. Haptic stimuli were presented via the PHANToM; visual stimuli were presented via computer monitor. The virtual surfaces were sinusoidal gratings that varied in spatial period across trials. Overall, results suggested that threshold was determined by haptic input at low surface amplitudes, and by visual input at high surface amplitudes. At intermediate amplitude values, it appeared that observers were combining information across modalities to produce a percept in the combined condition that was better than that obtained under either single modality condition.