Real Time Finger Typing Recognition on iPhone’s RGB Camera

Abstract

Recently, smartphone’s information processing capability has improved. Many softwares using cameras have increased, and the image processing can be performed in real time. The Original Character Input System proposed this real time composed of a character input system for the iPad application. Is a method of touching the tablet screen with five fingers and inputting characters with different combinations. The system proposed this real time picture taking of a finger typing on the camera of the smartphone then recognizes the typing fingertip in real time with the characters being inputted. As a result of the verification of the iPhone 8, the system can be processed with 30 FPS when the captured image with the size of 640 × 480 and the CPU usage rate of approximately 95%. In addition, the recognition rate for each finger typing is 100%.