Brain-Inspired Driver Emotion Detection for Intelligent Cockpits Based on Real Driving Data

Abstract

Affective human–vehicle interaction of intelligent cockpits is a key factor affecting the acceptance, trust, and experience for intelligent connected vehicles. Driver emotion detection is the premise of realizing affective human–machine interaction. To achieve accurate and robust driver emotion detection, we propose a novel brain-inspired framework for on-road driver emotion detection using facial expressions. Then, we conduct driver emotion data collection in an on-road context. We develop a data annotation tool, annotate the collected data, and obtain the RoadEmo dataset, a dataset of facial expressions and road scenarios under the driver’s emotional driving. Finally, we validate the detection accuracy of the proposed framework. The experiment results show that our proposed framework achieves excellent detection performance in the on-road driver emotion detection task and outperforms existing frameworks.