Implementation of the Interaction Effect Among Virtual Large Curved Screens on Multiple Buildings Based on Mixed Reality

Abstract

The glass-free three dimensional (3D) large screen has provided an ultra-sensory immersive visual experience, and broken the aesthetic fatigue of people to print advertising. But it’s also limited by the geographical location and high cost of installation, accordingly, the virtual large curved screens on multiple buildings with interaction effect based on mixed reality (MR) was designed and implemented in this paper. Firstly, the deep learning building detection and building surface recognition algorithm were adopted to recognize the building surfaces, and the recognized surfaces were further filtered and integrated, which then completed the positioning of multiple buildings virtual large screens based on the integrated multiple plane groups. Based on the simultaneous rendering of multiple virtual curved screens, several interaction modes were also designed between the large screen spaces, thus furtherly enhancing the user experience and application potential of the virtual curved screens. The overall program built modularly based on 3D engine achieves better recognition, rendering and interaction effects in mobile, which also provides new ideas for new forms of MR applications in urban environments.