Perception strategies in modal-redistributed interaction

Abstract

Computer interfaces provide information to users mostly graphically. This method of presentation is not suitable for the visually impaired or for users in situations where interaction is limited, like in mobile context. One possibility to present information to these kinds of users would be using melodic sounds and haptic feedback to replace graphical information. We describe a new method to redistribute graphical information to melodic sounds and haptic cues with a stick interface. We discuss the impact of this redistribution to user behavior in simple shape recognition tasks. Appropriateness of redistribution is evaluated and design recommendations given based on user behavior in modal-redistributed interaction.