Multi-sensory fusion and model-based recognition of complex objects

Abstract

Perception with complementary sensors like a color camera and a laser range finder, make easier the recognition of objects in a 3D scene. This paper copes with the recognition of non-polyhedral objects, described each one by a REV graph and an aspect table, required to afford reasoning about visibility. The authors focus on the relations between segmentation and recognition strategies. A set of segmentation operators, executed by logical sensors, can be requested with respect to the state of the recognition task, in order to extract the more suitable set of features from the sensory data; if needed, the fusion of perceptual data can provide the more accurate estimates of the perceived geometric features. The control module of the recognition task, follows a classical "hypothesize and test" paradigm; this paper concerns only the hypothesis generation and verification, after one acquisition. Recognition strategies could be compiled off line, according to the object and the sensor models. The authors show how such strategies allow one to limit complexity of the segmentation and recognition processes; experimental results on real perceptual data, validate this method.<>