Design and implementation of deep learning-based object detection and tracking system

Abstract

Many human tracking methods by deep learning rely on powerful computing resources. For embedded platforms with limited resources, efficient use of resources is a priority. In this paper, we design an object detection and tracking system based on deep learning methods. We propose an efficient system with software and hardware design. We apply the framework of Vitis AI and its Deep Learning Processing Unit using a hardware/software co-design approach. This approach capitalizes on a higher-level acceleration design framework, where the convolutional models can be updated more flexibly and rapidly. This design approach not only provides a fast design flow but also has good performance in terms of throughput. We facilitate the design and accelerate the object detection model YOLO v3 to achieve higher throughput and energy efficiency. Our tracking method achieves a 1.27x improvement in processing speed with the addition of a single-object tracker. Our proposed human tracking methods can achieve better performance than the others in precision with the same test sequences.