Assistive Robot, RGB-D Sensor and Graphical User Interface to Encourage Communication Skills in ASD Population

Abstract

The main feature of Autism Spectrum Disorders (ASDs) is the difficulty in communicating with others and struggling to maintain a functional contact with the environment. This work presents the implementation of a Graphical User Interface (GUI) for Digital PECS Therapy that will enable ASD population to overcome their impairments. The GUI was integrated with a depth sensor, to recognize hand gestures of autistic subjects, a monitor, where specific tools have been displayed, and a humanoid robot (Aldebaran Robotics NAO), used as a medium that will allow people with ASD to communicate their needs. Subjects can select the displayed pictures they want with hand movements, and the robot pronounces the represented objects. The system has been validated during therapeutic sessions with autistic subjects and the results are here reported and discussed supporting the idea that the presence of the robot helps to elicit triadic interactions in ASD.