Multi-sensor based planning and control for robotic manufacturing systems

A multi-sensor based planning and control scheme for robotic manufacturing is presented in this paper. The proposed approach fuses sensory information from various sensors at different temporal and spatial scales in an event-based planning and control scheme. By combining the measurement of an encoder sensor, relative spatial information obtained from processing of visual measurement is mapped to the absolute task-space of the robot, delayed data obtained from a displacement based vision algorithm that represent absolute part position measurement is brought to up to date. A four-step approach to planning and control of a robotic manipulator is discussed. An event-driven tracking and control scheme that is based on multi-sensor information is given. The approach is illustrated by considering a manufacturing workcell where the manipulator is commanded to pick up a part on a disc conveyor under the guidance of computer vision.