Design concept of sign language recognition translation and gesture recognition control system based on deep learning and machine vision

Abstract

With the development of society, gestures are used in many aspects, but the computer's functionality for gesture recognition is still to be improved. This article is mainly a preliminary idea of a basic gesture recognition system built based on the existing Google deep learning framework TensorFlow and gesture recognition components in MediaPipe and OpenCv machine vision open-source library. The training dataset is first subjected to skeleton key point coordinate extraction, then the pre-processed dataset is used to train the neural network and constitute the preliminary model, and finally the model is corrected and changed in the end.