Effective multimodal feedback for around-device interfaces

Abstract

Around-device interaction lets people use their phones without having to pick them up or reach out and touch them. This allows interaction when touch may not be available; for example, users could gesture to interact with their phones while cooking, avoiding touching the screen with messy hands. Well-designed feedback helps users overcome uncertainty during gesture interaction, however giving effective feedback from small devices can be a challenge and detailed visual feedback will not always be suitable. My thesis research looks at how other types of feedback may be used effectively during around-device interaction to help users.