Making Sense: Experiences with Multi-Sensor Fusion in Industrial Assistance Systems

Abstract

: This workshop paper discusses the application of various sensors in an industrial assembly scenario, in which multiple sensors are deployed to enable the detailed monitoring of worker activity, task progress and also cognitive and mental states. The described and evaluated sensors include stationary (RGBD cameras, stereo vision depth sensors) and wearable devices (IMUs, GSR, ECG, mobile eye tracker). Furthermore, this paper discusses the associated challenges mainly related to multi-sensor fusion, real-time data processing and semantic interpretation of data.