Attribute correlations between haptic and auditory modalities

Abstract

Correlations between attributes in the haptic domain and those in the auditory will assist in multimodal applications. This paper looks at the auditory attributes of pitch and reverberation and the haptic attributes of vibration, size and viscosity and seeks to correlate changes in one of the modalities with changes in the other. A total of 4 pairs of experiments were performed. The results indicate significant correlations in 3 of the pairs: pitch/vibration, pitch/viscosity, reverberation/size. There was no significant correlation found between reverberation and viscosity. These results have significance for designers of multimodal interfaces in virtual environments.