The closed-loop human-computer interface: active information acquisition for vision-brain-hand to computer (VBH-C) interaction based on force tablet

Abstract

As more attention on human beings, developing an effective communication interface connecting the human brain to computer becomes an active research area in recent years. Until now, no efficient device can record the entire procedure of intrinsic human behavior information, including acquiring, transmitting, processing and outputting. In this paper, we offer a system which consists of computer and F-tablet, the later can acquire the kinematics and kinetics information of human handwriting. Joined with human beings, a vision-brain-hand to computer (VBH-C) interaction system is presented. In this human-in-the-loop-testing system, human beings acquire image, voice or text from computer by eyes or ears then write them down. As a closed-loop feedback portion, the designed F-Tablet acquires strokes of pen-up and pen-down, velocity and acceleration of pen-tip, three dimension forces of pen-plate contacting point and shape of character etc. The core part of the system, named as F-Tablet, is introduced which is able to acquire the trajectory and three-axis forces directly and simultaneously of pen-tip. A simple test will be done to judge the movements and forces controlling ability of different ages with the help of the system. Comparing with other brain-computer interface (BCI), VBH-C interface can offer more information, especially as a closed-loop and information feedback, it is easier for human decision pattern identification.