Person counting using stereo

Abstract

Stores and shopping malls would like to keep track of shopper volume by employing automatic techniques for counting shoppers. Existing approaches instrument doors with infrared beams and count beam interruptions, but this approach cannot resolve groups of people well. We are applying a vision-based approach that detects and tracks people from a stereo camera mounted above a door and pointing down. After applying real-time stereo vision and 3D image reconstruction, the system segments the scene by selecting stereo pixels falling inside a 3D volume of interest, which is placed to capture the heads and torsos of adult shoppers. The main novelties of our approach include (1) remapping the stereo disparities to an orthographic "occupancy map", which simplifies person modeling, and (2) tracking people using a Gaussian mixture model. On a test set of 900 enter/exit events in four hours of video, our system has achieved a net counting error rate of just 1.4%.