End-to-End Texture-Aware and Depth-Aware Embedded Advertising for Videos

Abstract

The number of online videos is increasing rapidly with the prosperity of advertising market. To dig out the immense potential of videos, there are mainly two advertising types for commercial usage, mid-roll and embedded. Embedded advertisements, compared with mid-roll ones, is an imperceptible and brilliant strategy. However once the video is produced, the advertisement embedded in it is nonchangeable, which causes out-of-date advertisements or personalized advertising difficulty. Meanwhile, the trade-off among video webs' income, video shooters' production difficulty and video watchers' aesthetic taste remains as a challenge with previous advertising strategies. To solve the problems above, we propose a pipeline that automatically embeds advertisements in real-time into a monocular RGB video or a single RGB image. The pipeline detects a non-intrusive region with awareness of texture and depth, and overlays it with an advertisement. Tools such as segmentation and 3D reconstruction are used inside this pipeline to detect physical-world information. A corner-based tracker is built to preserve 3D shape information of the candidate region, which makes the embedded advertisement natural. the pipeline runs a shoot change detector in parallel to keep advertisement visible on the main scene.