Augmented reality coloring book: An interactive strategy for teaching children with autism to focus on specific nonverbal social cues to promote their social skills

Abstract

Autism spectrum disorders (ASD) reduce one’s ability to act appropriately in social situations. Increasing evidence indicates that children with ASD might ignore nonverbal social cues that usually aid social interaction because they do not recognize or understand them. We asked children with ASD to color an augmented reality coloring book (ARCB) to teach them how to recognize and understand some specific social signals and to ignore others. ARCB materials teach children to recognize and understand social signals in various ways. They can, for example, view 3D animations of the ARCB materials on a tablet computer. Thus, the ARCB can be used to help children with ASD focus their attention on the meaning and social value of nonverbal behaviors in specific social situations. The ARCB has multiple functions: it extends the social features of the story, and it restricts attention to the most important parts of the videos. Single-subject research with a multiple-baselines across-subject design was used in this study. After five weeks of ARCB training intervention, all 3 participants’ scores rose significantly and dramatically during the intervention phase (mean rate of correct answers improved from 14.24% to 47.33%), and remained significantly higher in the maintenance phase than at baseline. We conclude that coloring pictures of social situations may help children with ASD recognize and better understand these situations.