Multi-modal Conversational Search for People with Intellectual Disability: An Exploratory Study

Abstract

Like us all, people with intellectual disability are self-motivated learning and are enthusiastic information seekers. However, there are some technical challenges for people with intellectual disability when accessing required information and interacting with conversational search systems. This paper presents the preliminary development of a simulated multi-modal conversational search system to understand its potentials and limitations for people with intellectual disability. To conduct an exploratory study, we developed a Wizard of Oz conversational multi-modal system which records user activities, including touch, text and verbal interactions. Then, we preliminary evaluated the system with eight adults with intellectual disability in one of two different information-seeking scenarios – in an individual and collaborative setting. Drawing on the findings and insights of the study, participants valued the system as it fulfilled their information retrieval needs, and it achieved an acceptable level of accessibility. These findings and future research into this topic can guide accessibility improvements to current search systems and the development of future conversational search systems.