AR Mobile Video Calling System Based on WebRTC API

Abstract

During the COVID-19 pandemic, the demand for video calling and video conferencing is at peak and continues to grow. Integrating Augmented Reality (AR) with a regular video call can deliver a more interactive, immersive, and collaborative communication experience. This paper presents an AR video calling system that uses WebRTC protocol for establishing real-time video communication and uses AR SDK such as Google AR Core for adding AR features over the lively streaming video feed. To evaluate the performance and feasibility of the proposed AR video calling system, we implemented it on an Android mobile device and measured the relevant performance data, such as frame rate, CPU usage and network usage. The experimental results suggest that the proposed system is practicable and stable.