Viewport Prediction via Adaptive Edge Offloading

Abstract

The pursuit of enhanced interactive visual experiences has created growing interest in 360-degree video streaming. However, transmitting such content requires significant bandwidth compared to conventional planar video, motivating a search for effective bandwidth optimization strategies. A promising approach involves predicting viewport and prioritizing transmission of the regions of interest at higher quality. The existing methods for viewport prediction rely on sophisticated neural networks hosted on servers and face major bandwidth and latency challenges. This letter proposes a hierarchical approach to viewport prediction that leverages a small model on edge devices and offloads to the server only the most challenging tasks. The offloading algorithm relies on rate control to maximize the performance while meeting resource constraints, presenting a novel solution to bandwidth-efficient viewport prediction for 360-degree video streaming.