Hyve-3D and rethinking the "3D cursor": unfolding a natural interaction model for remote and local co-design in VR

Hybrid Virtual Environment 3D (Hyve-3D) is a system to actively design inside Virtual Reality by a new model of interaction through a 3D cursor that is specially envisioned to facilitate local and remote collaboration. It introduces a novel approach to the concept of the cursor inside the 3D virtual space, rethinking it as a drawing and control plane. 3D cursors are intuitively manipulated by multi-touch handheld tablets that are tracked in 6DOF. The system also features a lightweight immersive 3D rendering technique that runs on a single laptop allowing texture and lighting effects on 3D geometry. Users can simultaneously access their individual complementary orthogonal views on the tablets, as personal windows into the shared display of the virtual environment; they can concurrently 3D sketch, select, edit, manipulate 3D objects using the tablets as tangible props, as well as collectively navigate the scene using the tablet as a 3D trackpad. With the notion of multiple 3D cursors the personal computer becomes a collaborative working environment. The first version was implemented in 2014 [Dorta et al. 2014]. A product level system is presented with the immersive and non immersive implementations. A variation of the interface which works without the need of an external tracker is also demostrated that opens the possibility of using the system with any handheld device such as smart phones and watches.