Mobile Hand Gesture Controlled Application using Transfer Learning

Abstract

An increasing number of companies move to a touchless user interface, partly because of the pandemic's impact and the restricted rules of using public access objects. The market for Zero User Interface is increasing and industrial implementations are growing and promising. Currently, the knowledge of keeping yourself healthy and clean is essential to prevent the spread of Covid-19 disease. A proposed project – a hand gesture-controlled application to properly guide the user through the handwashing process can increase the overall level of hygiene in public. The solution is realized with a transfer learning method based on EfficientNet Lite models making it possible to run on Android, iOS, embedded Linux devices, and microcontrollers.