Interactive educational game using machine learning

Abstract

In the last decades we have witnessed a steep evolution of computer games. Thus, the content of games and experiences has evolved from 2d to 3d, from basic puzzles to elaborated open-world games, the interaction remained approximately the same. Button and touch-based experiences are the second nature of children nowadays. Virtual reality brought a new way of designing and addressing games, but there was little innovation when it comes to interaction. Machine learning can bring to the table a whole new perspective on the game-play experience available for children [1]. Walking in a virtual environment using face tracking, going left or right using Leap Motion sensor, opening doors with voice commands and shooting using muscle-flexing gesture, all of these combined with educational content can represent a new level on learning by playing.