Design and implementation of the teleoperation platform based on augmented reality

Abstract

Predictive display based on virtual environment models is an effective method of solving the problem of time delay in teleoperation. However, this method will not work well without the precise virtual environment model. Thus, it is of great significance that augmented reality with video feedback is introduced into teleoperation, instead of the virtual environment models. A teleoperation system platform based on augmented reality was developed to improve system stability and enhance system telepresence, facilitating the operator's observation and operation. The improved algorithm ARToolkit-based made the system adaptable to many types of lighting environments. This paper introduces system structure and the realization of key modules. Lots of experiments such as pressing the button, pulling the drawer and so on are also conducted to evaluate the system performance. The simulation results indicate that the proposed system can compensate the defect of prediction and improve teleoperation system reliability.