Automation of the Behavioral Safety Audit of a Transport Operator Based on the Recognition of His Emotional State in Real Time

In this paper, an approach to automating the conduct of behavioral audit of transport safety is considered. Also, it is proposed to use cameras and electromyographic sensors directly attached to an employee of the organization - to monitor his condition in real time. In a similar way, it is possible to determine the emotional state of transport operators, their fatigue by analyzing a series of received images of a person and read signals from wearable sensors when directly in the process of performing a work task. The strongest emotions, such as happiness, surprise, as well as determining a person’s fatigue, can be determined by individual segments of a person’s image - the state of his eyes, mouth, eyebrows, head position. It is possible to increase the accuracy of determining the operator’s reactions, for example, by using electromyographic sensors installed on the operator’s face and hands.