Immersive Learning Aid for Children with Autism(ASD) using Object Recognition

Abstract

Autism Spectrum Disorder is a chronic developmental disorder afflicting patients in their early formative years. Without a definitive cure, children can experience a spectrum of symptoms from difficulties with communication, social interaction, and obsessive/repetitive behaviour. These symptoms affect the children’s opportunities to experience and learn ideas and concepts, unlike their peers. With assisted learning and therapy, children with Autism can become independent members of society. The proposed system contributes to the child’s learning curriculum by offering education attractively and entertainingly. The premise of a smartphone or a tablet as the only hardware requirement breeds familiarity with the user and promotes comfort when utilizing the application. The system consists of an application that renders augmented reality objects onto the device screen when the camera module recognizes target objects in the frame. The application processes target information using the Vuforia Engine by scanning the images of the video stream for targets. The target is either an image or three-dimensional object stored locally in a database. The application can identify and process multiple targets to render a combination of text, image, audio, video, and three-dimensional objects. The application’s ease of usage combined with immersion provides a conducive environment for learning concepts and subjects of various fields.