Interaction by Hand-Tracking in a Virtual Reality Environment

Abstract

This article describes the elaboration of a low-cost system that allows user interaction with VR environments modeled in Unity and viewed through Google Cardboard. The proposed system divides the processing in a client-server architecture in which the VR experience is executed on the client, while it sends pictures captured from the mobile device inside the Card Board to the server. This server processes the hand pose information and sends it to the client.