Gaze-driven Interaction System for Cognitive Ability Assessment

Autism Spectrum Disorder (ASD), usually discovered in childhood, is a neurodevelopmental disorder with clinical manifestations like social communication disorders, stereotyped behaviors, and narrow interests. Incomplete cognitive ability is one reason that causes social communication disorders among autistic children. Therefore, it is critical to evaluate the cognitive abilities of autistic children and provide guidance for subsequent intervention programs. In this work, we present a gaze-driven interaction system, assessing the cognitive performance of the subject. Based on our paradigms, an interface that contains specific pictures, videos and games creates a bond of interaction between subjects and the system. During the assessment process, the gaze features of subjects will be captured for deducing a cognitive ability index, which is used for judging the degree of cognition. The result shows that our system can evaluate the cognitive ability ranging from colors, shapes, emotions to social relationships, and provide guidance for the formulation of follow-up personalized intervention programs.