Near-sensor image processing: theory and practice

Abstract

Near-sensor image processing, NSIP, is a concept where the temporal behavior of the photodiode is used to perform image processing. It has been shown that many conventional image processing operations like convolution and gray scale morphology can easily be implemented in NSIP. In this paper we describe the basis of NSIP and how the sensor/processor architecture is used to perform local as well as global operation. An implementation of an NSIP chip also is described. Finally, we show a number of algorithms and applications which have been implemented in our NSIP camera system.