Layered-XR: A Utility Virtual-Real Fusion Based on Layer Sets

Abstract

With the increasing cultural needs of people, traditional performances are facing unprecedented challenges. Extended Reality (XR) has dramatically improved the audiovisual experience of the audience. However, previous virtual-reality fusion technology requires professional operation and high cost, limiting its large-scale application. One promising solution is to decompose complex fusion space into different video layers for independent processing to reduce operation difficulty and cost. Consequently, this paper proposes a utility virtual-real fusion framework based on layer sets (Layered-XR) by inserting various user-defined ‘virtual’ and ‘real’ contents into different video layers equipped with the presentation switch that efficiently operates on/off of layers in real-time. The application of the proposed framework in virtual broadcasting verified that the Layered-XR realized utility and efficient solutions for virtual-real fusion video production.