Deluceva: Delta-Based Neural Network Inference for Fast Video Analytics

Abstract

Modern video analytics requires efficient machine learning model serving and evaluation. We present Deluceva, a system that optimizes video applications by applying incremental and approximate computation techniques. Experiments on three real models and six videos show that our prototype system can achieve significant performance gains up to 79% with F1 errors below 0.1.