On Stage Interactive Spatial AR for Drama Performance

Abstract

The authors fuse the virtual objects and visual effects (VFX) and the performance of actors and actresses on real drama stage by developing an interactive spatial AR system, in which actors and actresses were interacting with virtual objects and VFX by their motion and gesture in real-time performance, and the images of virtual objects and VFX that projected on a transparent projection screen were aligned and matched to calibrate with their body part's position. The audience will see virtual objects and VFX are seamlessly matched on the real performers on stage space as if they are real things that are just under the control of the real performers. The audience will immerse into the drama scenes more deeply, hence offering the audience higher aesthetics feelings also bringing new possibilities to drama art creation.